Sunday, September 23, 2012

If not in PRODUCTION, you are not having enough fun

After go trough every environment: DEV, TEST and PRE-PROD, we were "ready" for the outage on PROD to go from Oracle Database 10g R2 (10.2.0.3) to 11g R2 (11.2.0.3).
As you may know there are some steps that you can execute before the outage begins, so here we go...
For last PSU, CPU or Patch Sets you must mark as "favorite" the following Note in your MOS:

Quick Reference To Patch Numbers For Database PSU, CPU And Bundle Patches [ID 1454618.1]
 
The above was a quick "Place Commercial Here", so where were we? Sure.. the steps, there is another Note, to guide you step by step what you should do in your way to upgrade from any version to 11.2.0.3: Complete Checklist for Manual Upgrades to 11gR2 [ID 837570.1]

On Step 2 you are supposed to run the 
 $ORACLE_HOME/rdbms/admin/utlu112i.sql

Remember that you need to copy this script from the new 11gR2 Home and run it in the actual Database Home, in our case the one in 10.2.0.3.

$ sqlplus '/ as sysdba'
SQL> spool upgrade_info.log
SQL> @utlu112i.sql
SQL> spool off

Thing is, that when I executed the script an odd error appears, well is not that odd but, what are the chances, when you know that your DB is up and running:

ORA-03114: Not Connected to Oracle 

We look forward into the alert.log (this is a very good practice, if you are new in the Oracle World), the following error appears.

ORA-07445: exception encountered: core dump [strlen()+24] [SIGSEGV] [Address not mapped to object] [0x00038001D] [] []

So check out the following note, which is very helpful if you have any ORA-07445 or ORA-600 errors.: ORA-600/ORA-7445/ORA-700 Error Look-up Tool [ID 153788.1]

From the Note above, we found this one ORA-07445 [STRLEN()+24] Running Command 'Show Parameter' [ID 1078807.1]

Cause

The error is caused by unpublished Bug 5634026 ORA-07445 Exception Encountered Core Dump _NDOPRNT() During Upgrade (and this bug is for 10.2.0.3)

 
Solution? Pretty easy... they give you 3 options...

Apply Patch 5634026 if available in your version/platform
OR
Apply the 10.2.0.4 patchset if running 10.2
OR
Apply the 11.1.0.7 patchset if running 11.1

Counting on that you are in an Upgrade Outage, and you NEED to run the utlu112i.sql, you should choose the first one. Yes I know, this is a Patch that would be only applied in PROD environment (if you remember all went smooth in our other environments), but it worked for us.

Happy Upgrading...