GLOC 2014 NEOOUG - R12 Upgrade Downtime Reduction

Copyright © 2013 OneNeck IT Services Corporation. All Rights Reserved. 1

Weekend Upgrade EBS 11i to R12

- Real World Tips to Reduce

Upgrade Downtime

Biju Thomas 13-May-14


Weekend Upgrade

EBS 11i to R12 -

Real World Tips to Reduce

Upgrade Downtime


Speaker

• Oracle ACE

• Principal Solutions Architect with OneNeck® IT Solutions

• More than 20 years of Oracle database administration experience and over 7 years of E-Business Suite experience

• Author of Oracle12c OCA, Oracle11g OCA, co-author of Oracle10g, 9i, 8i certification books published by Sybex/Wiley.

• Presentations, Articles, Blog, Tweet


Session Objectives

• R12.1.3 Upgrade Overview

• Case Study Environment

• Upgrade Timing and Tuning

• Upgrade Version Choice (12.2 or 12.1)

• Reference Documents


R12.1.3 UPGRADE OVERVIEW


Upgrading to 12.1.3

Pre-Tasks

• Pre-Tasks – Recommended and Required

Steps, prior to R12 Upgrade

– Upgrade database to 11gR2 – latest patch set

and PSU (11.2.0.4)

– Configure EBS instance to use Oracle

Applications Tablespace Model (OATM)

– Apply pre-requisite EBS patches, such as 11i

sustaining support patches and ATG Rollup

Patch 6 or higher.


Getting Ready for Upgrade

• Reference

– Oracle® E-Business Suite Upgrade Guide

Release 11i to 12.1.1 Part No. E16342-04

• TUMS Patch and Report

– Lists tasks that you can omit from the upgrade

because they do not apply to your system

• Functional Steps to prepare for upgrade

– CRM, Financials, Procurement, Projects,

SCM, etc.


Base Release Upgrade

(12.1.1)

• Lay down file system [Rapid Install]

• AD Upgrade Driver for 12.1.1 (patch

7461070)

• American English unified driver

(u6678700.drv)

• Apply product patches


Upgrade to Latest Release

(12.1.3)• Reference

– Oracle E-Business Suite Release 12.1.3 Readme (Doc ID 1080973.1)

• Upgrade to 12.1.3– Use AutoPatch to apply R12.AD.B.DELTA.3 Patch 9239089

– Use AutoPatch to apply Oracle E-Business Suite Release 12.1.3 Patch 9239090

– Use AutoPatch to apply the latest consolidated online help Patch 9239095

• Post 12.1.3 patches – RPC1 : Released 29-Mar-14 (Oracle E-Business Suite Release

12.1.3+ Recommended Patch Collection 1 (RPC1) (Doc ID 1638535.1)• Combines recommended post-12.1.3 patches into a single,

integrated and regression-tested patch to ensure successful installation

– Product specific patches

• Post-install Applications Technology patches


Post Upgrade Setup &

Validation

• Customization/CEMLI setup

• Functional Setup, Changes, Configuration

• Third party tools configuration

• IT validation

• User validation


CASE STUDY ENVIRONMENT


Upgraded Environment

Properties 11i Instance R12 Instance

ASM/ Database

version

Oracle 11gR2 11.2.0.3 Oracle11gR2 11.2.0.3

Instance Type Single instance – Non-RAC, on

Solaris Cluster

Two Node – RAC on Solaris HA

Cluster

EBS OS Version RedHat Linux 4 – 32 bit Oracle Linux OEL 6.3 – 64 Bit

EBS version 11.5.10.2 12.1.3

EBS Nodes 1 x Admin + Concurrent Manager

2 x Web/Forms (Load Balanced)

External – iSupplier

Discoverer

1 x Admin + Concurrent Manager

1 x Concurrent Manager (PCP)

2 x Web/Forms (Load Balanced)

External – iSupplier

Discoverer

EBS Server type Physical Virtual node on VMWare using

OEL.

Discoverer Dedicated Physical Dedicated discoverer node – Virtual


Database Migration to

New Hardware• Standby database created

on new h/w before upgrade

• Instance required new name for R12

• During upgrade window, standby broken and database renamed to FCO (15 mins)

• After R12 upgrade database started in RAC mode as FCO1 and FCO2 instances (10 mins)

M9000 M5000 M5000

RACSTANDBY

DATABASE

P11i P11i

M9000 M5000 M5000

RAC

P11i FCO

M9000 M5000 M5000

RAC

P11i FCO1 FCO2


UPGRADE TIMING AND TUNING


Upgrade Tuning Major Phases

R12.1.3 Partially Tuned Upgrade

11i Preparation

(3.5 hrs)

R12.1.1 Upgrade

(22 hrs)

R12.1.3 Upgrade

(8 hrs)

Post Upgrade Steps

(10 hrs)

Functional Setup & IT Testing

(8 hrs)

R12.1.3 Final Tuned Upgrade

11i Preparation

(1.5 hrs)

R12.1.1 Upgrade

(7 hrs)

R12.1.3 Upgrade

(4 hrs)

Post Upgrade Steps

(6 hrs)

Functional Setup & IT

Testing

(6 hrs)

Total 51.5

Total 24.5


Upgrade Tuning 12.1.3 –

Biggest Gains• Storage change from EMC Clarion to VMAX with

SSD.

• More CPU and Memory on DB node to support multiple workers (48). More memory on CM/Admin node.

• Review timing report – APPL_TOP/admin/<SID>/out directory – file

adt<session_id>.lst

– Tune long running jobs by identifying the SQL. Most likely a MOS note available with fix.

– Skip jobs that are running against unused modules (after confirming with Oracle Support)

• “exit 0”



Biggest Gains - 2• Skip install/setup by using Save and Restore.

– Rapid Install 12.1.1 file system (patched).

– Tech stack Oracle home with latest patches.

– CEMLI directories

– Configuration files• Context Files

• spfile, tnsnames.ora, listener.ora files

– Key profiles, PCP configuration, MRP setup

– Discoverer Noetix EU Schema

• Entropy waits problem - Setup “rngd” daemon on application nodes– Java processes waiting on CPU

– Trace shows “[pid 3238] <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)”



More… 1

• Upgrade with only one RAC node.

– Setup cluster and RAC instances

– Start only one instance as non-RAC database for upgrade

– Start DB as RAC after 12.1.3 upgrade.

• No flashback, no archivelog mode

• Tune database parameters – parallelism, multi-block reads, SGA, etc

• Continuous Compile of invalid objects “utlrp” single thread


Upgrade Tuning 12.1.3

More… 2 • Distributed patching for 12.1.3

• Parallel AutoConfig

• Tune max# workers

• Import Statistics after upgrade

• Automate by scripting, including skipping known failed workers– update applsys.fnd_install_processes set status='C' where filename in ('cstdacr.sql',

'wshup124.sql', 'MSDODPCODE.sql', 'EGOSILDU.sql','jaiitemtemplcr.sql', 'JAIRCVDFF.sql', 'FndXdfCmp.class') and status='F';

• Complete as much as tasks much earlier

– Upgrade database to 11gR2, PSU, Required patches, OATM, etc

– Multi-Org, Data cleanup

• Repeatable process

– Document all issues and resolution for each iteration

• Project Management– Detailed tasks, estimated start and elapsed times


Tips from Oracle ATG

• Oracle E-Business Suite Reducing Downtime Upgrading to 12.1/12.2 (Doc ID 1578187.1)

– 130+ slides – very comprehensive

– Pay attention to pre-upgrade activities, Configuration and Performance sections.

• Purge & Archive… reduce database size!


UPGRADE VERSION CHOICE


Ready for R12.2?

• Which Oracle E-Business Suite Release Should You Target: 12.1 or 12.2? (Doc ID 1592197.1)

• Smaller EBS system

• Hard to find downtime window to apply patches

• Cannot afford two upgrades and testing – to 12.1 and then 12.2

• 12.2 functional enhancements important for business


Ready for 12c?

• Supported by 11i (11.5.10.2) and 12.x

• Interoperability Notes EBS 12.0 or 12.1 with RDBMS 12cR1 (Doc ID 1524398.1)– Install the 12.1.0 software

– Install Oracle Database 12c Products from the 12c Examples CD

– Create OH/nls/data/9idata directory

– Apply additional 12.1.0.1 RDBMS patches

– Upgrade the database instance

– Modify initialization parameters

– Perform patch post-install instructions

– Post upgrade tasks

– Implement and run AutoConfig


ORACLE REFERENCE DOCUMENTS


MOS References

• R12.1 / R12.2 : Oracle E-Business Suite Releases 12.1 and 12.2 Release Content (Doc ID 1302189.1)

• R11i / R12 : Database Documentation Resources for the E-Business Suite (Doc ID 1072409.1)

• Oracle Applications Release 12 Upgrade Sizing and Best Practices (Doc ID 399362.1)

• Database Preparation Guidelines for an E-Business Suite Release 12.1 Upgrade (Doc ID 761570.1)

• Oracle E-Business Suite Reducing Downtime Upgrading to 12.1/12.2 (Doc ID 1578187.1)

• Oracle E-Business Suite Recommended Performance Patches (Doc ID 244040.1)

• Patch Requirements for Sustaining Support for Oracle E-Business Suite Release 11.5.10 (Doc ID 883202.1)


Thank you!

Thank you for your time…

Contact:Tweets: @Biju_ThomasFacebook: OracleNotes

Blog: www.bijoos.com/oraclenotes

Please Complete “Feedback” on Guidebook

GLOC 2014 NEOOUG - R12 Upgrade Downtime Reduction

Technology

Transcript of GLOC 2014 NEOOUG - R12 Upgrade Downtime Reduction