After completing GI upgrade, what’s the most efficient way to mine results?
Upgrade GI to 19.6: typical information provided from terminal
[oracle@ol7-122-rac1 ~]$ /u01/app/19.6.0.0/grid/gridSetup.sh -applyRU /u01/app/oracle/patch/30501910 Preparing the home to patch... Applying the patch /u01/app/oracle/patch/30501910... Successfully applied the patch. The log can be found at: /u01/app/oraInventory/logs/GridSetupActions2020-03-04_00-24-53AM/installerPatchActions_2020-03-04_00-24-53AM.log Launching Oracle Grid Infrastructure Setup Wizard... The response file for this session can be found at: /u01/app/19.6.0.0/grid/install/response/grid_2020-03-04_00-24-53AM.rsp You can find the log of this install session at: /u01/app/oraInventory/logs/GridSetupActions2020-03-04_00-24-53AM/gridSetupActions2020-03-04_00-24-53AM.log [oracle@ol7-122-rac1 ~]$
Example response file from 12.2 install:
[oracle@ol7-122-rac1 response]$ pwd /u01/app/12.2.0.1/grid/install/response [oracle@ol7-122-rac1 response]$ sdiff -iEZbWBs -w 150 gridsetup.rsp grid_*.rsp INVENTORY_LOCATION= | INVENTORY_LOCATION=/u01/app/oraInventory oracle.install.option= | oracle.install.option=CRS_CONFIG ORACLE_BASE= | ORACLE_BASE=/u01/app/oracle oracle.install.asm.OSDBA= | oracle.install.asm.OSDBA=dba oracle.install.asm.OSASM= | oracle.install.asm.OSASM=dba oracle.install.crs.config.gpnp.scanName= | oracle.install.crs.config.gpnp.scanName=ol7-122-scan oracle.install.crs.config.gpnp.scanPort= | oracle.install.crs.config.gpnp.scanPort=1521 oracle.install.crs.config.ClusterConfiguration= | oracle.install.crs.config.ClusterConfiguration=STANDALONE oracle.install.crs.config.configureAsExtendedCluster= | oracle.install.crs.config.configureAsExtendedCluster=false oracle.install.crs.config.clusterName= | oracle.install.crs.config.clusterName=ol7-122-cluster oracle.install.crs.config.gpnp.configureGNS= | oracle.install.crs.config.gpnp.configureGNS=false oracle.install.crs.config.autoConfigureClusterNodeVIP= | oracle.install.crs.config.autoConfigureClusterNodeVIP=false oracle.install.crs.config.gpnp.gnsOption= | oracle.install.crs.config.gpnp.gnsOption=CREATE_NEW_GNS oracle.install.crs.config.clusterNodes= | oracle.install.crs.config.clusterNodes=ol7-122-rac1.localdomain:ol7-12 oracle.install.crs.config.networkInterfaceList= | oracle.install.crs.config.networkInterfaceList=eth1:192.168.56.0:1,eth oracle.install.asm.configureGIMRDataDG= | oracle.install.asm.configureGIMRDataDG=false oracle.install.crs.config.useIPMI= | oracle.install.crs.config.useIPMI=false oracle.install.asm.storageOption= | oracle.install.asm.storageOption=ASM oracle.install.asmOnNAS.configureGIMRDataDG= | oracle.install.asmOnNAS.configureGIMRDataDG=false oracle.install.asm.diskGroup.name= | oracle.install.asm.diskGroup.name=DATA oracle.install.asm.diskGroup.redundancy= | oracle.install.asm.diskGroup.redundancy=EXTERNAL oracle.install.asm.diskGroup.AUSize= | oracle.install.asm.diskGroup.AUSize=4 oracle.install.asm.diskGroup.disksWithFailureGroupNames= | oracle.install.asm.diskGroup.disksWithFailureGroupNames=/dev/oracleasm oracle.install.asm.diskGroup.disks= | oracle.install.asm.diskGroup.disks=/dev/oracleasm/asm-disk3,/dev/oracl oracle.install.asm.diskGroup.diskDiscoveryString= | oracle.install.asm.diskGroup.diskDiscoveryString=/dev/oracleasm/* oracle.install.asm.gimrDG.AUSize= | oracle.install.asm.gimrDG.AUSize=1 oracle.install.asm.configureAFD= | oracle.install.asm.configureAFD=false oracle.install.crs.configureRHPS= | oracle.install.crs.configureRHPS=false oracle.install.crs.config.ignoreDownNodes= | oracle.install.crs.config.ignoreDownNodes=false oracle.install.config.managementOption= | oracle.install.config.managementOption=NONE oracle.install.config.omsPort= | oracle.install.config.omsPort=0 oracle.install.crs.rootconfig.executeRootScript= | oracle.install.crs.rootconfig.executeRootScript=false [oracle@ol7-122-rac1 response]$
Review response file: compare original response file versus the one used for upgrade (grid_2020-03-04_00-24-53AM.rsp)
[oracle@ol7-122-rac1 response]$ pwd /u01/app/19.6.0.0/grid/install/response [oracle@ol7-122-rac1 response]$ ls -l total 76 -rw-r--r--. 1 oracle oinstall 36450 Mar 4 00:38 grid_2020-03-04_00-24-53AM.rsp -rw-r-----. 1 oracle oinstall 36221 Jan 19 2019 gridsetup.rsp -rw-r-----. 1 oracle oinstall 1541 May 21 2016 sample.ccf [oracle@ol7-122-rac1 response]$ sdiff -iEZbWBs -w 150 gridsetup.rsp grid_*.rsp INVENTORY_LOCATION= | INVENTORY_LOCATION=/u01/app/oraInventory oracle.install.option= | oracle.install.option=UPGRADE ORACLE_BASE= | ORACLE_BASE=/u01/app/oracle oracle.install.crs.config.scanType= | oracle.install.crs.config.scanType=LOCAL_SCAN oracle.install.crs.config.ClusterConfiguration= | oracle.install.crs.config.ClusterConfiguration=STANDALONE oracle.install.crs.config.configureAsExtendedCluster= | oracle.install.crs.config.configureAsExtendedCluster=false oracle.install.crs.config.clusterName= | oracle.install.crs.config.clusterName=ol7-122-cluster oracle.install.crs.config.gpnp.configureGNS= | oracle.install.crs.config.gpnp.configureGNS=false oracle.install.crs.config.autoConfigureClusterNodeVIP= | oracle.install.crs.config.autoConfigureClusterNodeVIP=false oracle.install.crs.config.gpnp.gnsOption= | oracle.install.crs.config.gpnp.gnsOption=CREATE_NEW_GNS oracle.install.crs.config.clusterNodes= | oracle.install.crs.config.clusterNodes=ol7-122-rac2:,ol7-122-rac1: oracle.install.crs.configureGIMR= | oracle.install.crs.configureGIMR=true oracle.install.asm.configureGIMRDataDG= | oracle.install.asm.configureGIMRDataDG=false oracle.install.crs.config.storageOption= | oracle.install.crs.config.storageOption=FLEX_ASM_STORAGE oracle.install.crs.config.useIPMI= | oracle.install.crs.config.useIPMI=false oracle.install.asm.diskGroup.name= | oracle.install.asm.diskGroup.name=DATA oracle.install.asm.diskGroup.AUSize= | oracle.install.asm.diskGroup.AUSize=0 oracle.install.asm.gimrDG.AUSize= | oracle.install.asm.gimrDG.AUSize=1 oracle.install.asm.configureAFD= | oracle.install.asm.configureAFD=false oracle.install.crs.configureRHPS= | oracle.install.crs.configureRHPS=false oracle.install.crs.config.ignoreDownNodes= | oracle.install.crs.config.ignoreDownNodes=false oracle.install.config.managementOption= | oracle.install.config.managementOption=NONE oracle.install.config.omsPort= | oracle.install.config.omsPort=0 oracle.install.crs.rootconfig.executeRootScript= | oracle.install.crs.rootconfig.executeRootScript=false [oracle@ol7-122-rac1 response]$
Review log directory:
[oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$ pwd /u01/app/oraInventory/logs/GridSetupActions2020-03-04_00-24-53AM [oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$ ls -alrt total 17988 -rw-r-----. 1 oracle oinstall 11578 Mar 4 00:31 installerPatchActions_2020-03-04_00-24-53AM.log -rw-r-----. 1 oracle oinstall 0 Mar 4 00:31 gridSetupActions2020-03-04_00-24-53AM.err drwxrwx---. 3 oracle oinstall 21 Mar 4 00:31 temp_ob -rw-r-----. 1 oracle oinstall 0 Mar 4 00:38 oraInstall2020-03-04_00-24-53AM.err -rw-r-----. 1 oracle oinstall 157 Mar 4 00:38 oraInstall2020-03-04_00-24-53AM.out -rw-r-----. 1 oracle oinstall 9728749 Mar 4 00:39 gridSetupActions2020-03-04_00-24-53AM.out -rw-r-----. 1 oracle oinstall 0 Mar 4 00:44 oraInstall2020-03-04_00-24-53AM.err.ol7-122-rac2 -rw-r-----. 1 oracle oinstall 142 Mar 4 00:44 oraInstall2020-03-04_00-24-53AM.out.ol7-122-rac2 -rw-r-----. 1 oracle oinstall 29328 Mar 4 02:05 time2020-03-04_00-24-53AM.log -rw-r-----. 1 oracle oinstall 8624226 Mar 4 02:05 gridSetupActions2020-03-04_00-24-53AM.log drwxrwx---. 12 oracle oinstall 4096 Mar 4 02:18 .. drwxrwx---. 3 oracle oinstall 4096 Mar 4 03:20 .
Review .err file: 0 byte is good
[oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$ ls -l *.err -rw-r-----. 1 oracle oinstall 0 Mar 4 00:31 gridSetupActions2020-03-04_00-24-53AM.err -rw-r-----. 1 oracle oinstall 0 Mar 4 00:38 oraInstall2020-03-04_00-24-53AM.err
Review grid action: for verification purpose grep log for when grid was configure vs upgrade for comparison
[oracle@ol7-122-rac1 GridSetupActions2020-03-03_01-26-02AM]$ grep -i getInstallOption gridSetupActions*.log INFO: [Mar 3, 2020 1:26:05 AM] getInstallOption: CRS_CONFIG [oracle@ol7-122-rac1 GridSetupActions2020-03-03_01-26-02AM]$ [oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$ grep -i getInstallOption gridSetupActions*.log INFO: [Mar 4, 2020 12:32:07 AM] getInstallOption: UPGRADE [oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$
Check for distinct keywords:
[oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$ grep -e '[[:upper:]]: ' gridSetupActions*.log | cut -d ":" -f1 | sort -u
ACTION
APPLICATION_ERROR
CAUSE
INFO
Output
TaskUsersWithSameID
WARNING
Check APPLICATION_ERROR:
[oracle@ol7-122-rac1 GridSetupActions2020-03-04_00-24-53AM]$ grep -B3 -A1 APPLICATION_ERROR gridSetupActions*.log
INFO: [Mar 4, 2020 12:35:27 AM] INFO: [Task.perform:873]
TaskCheckRPMPackageManager:RPM Package Manager database[TASKCHECKRPMPACKAGEMANAGER]:TASK_SUMMARY:FAILED:INFORMATION:INFORMATION:Total time taken []
ERRORMSG(GLOBAL): PRVG-11250 : The check "RPM Package Manager database" was not performed because it needs 'root' user privileges.
APPLICATION_ERROR: NodeResultsUnavailableException thrown when hasNodeResults() returns true
INFO: [Mar 4, 2020 12:35:27 AM] INFO: [Task.perform:799]
Did you noticed that I used wildcard for the search?
It does not matter since the log for each task will typically be in different directories.
This is the one thing I noticed Oracle did correctly as it’s much easier to the same commands for any environments.