CRS and Cluster, what’s the difference and which one should I use for start and stop?
CRS is Cluster Ready Service and used to manage HAS (High Availability Services)
Cluster is where the application runs on.
Stop CRS is local to the node and will shutdown local HAS – crsctl stop crs
Stop cluster will shutdown across all nodes and will NOT shutdown HAS – crsctl stop cluster -all
Here’s the catch.
Start cluster will NOT start the node without HAS running – crsctl start cluster -all
The node must be started manually – crsctl start crs
DEMO:
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
NAME=rac01 STATE=ONLINE NAME=rac02 STATE=ONLINE NAME=rac03 STATE=ONLINE
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac01' CRS-2673: Attempting to stop 'ora.crsd' on 'rac01' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac01' CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac01' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac01' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac01' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.rac01.vip' on 'rac01' CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac01' CRS-2677: Stop of 'ora.scan2.vip' on 'rac01' succeeded CRS-2672: Attempting to start 'ora.scan2.vip' on 'rac02' CRS-2677: Stop of 'ora.rac01.vip' on 'rac01' succeeded CRS-2672: Attempting to start 'ora.rac01.vip' on 'rac03' CRS-2676: Start of 'ora.rac01.vip' on 'rac03' succeeded CRS-2676: Start of 'ora.scan2.vip' on 'rac02' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'rac02' CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'rac02' succeeded CRS-2677: Stop of 'ora.DATA.dg' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac01' CRS-2677: Stop of 'ora.asm' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'rac01' CRS-2677: Stop of 'ora.ons' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac01' CRS-2677: Stop of 'ora.net1.network' on 'rac01' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac01' has completed CRS-2677: Stop of 'ora.crsd' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac01' CRS-2673: Attempting to stop 'ora.ctssd' on 'rac01' CRS-2673: Attempting to stop 'ora.evmd' on 'rac01' CRS-2673: Attempting to stop 'ora.asm' on 'rac01' CRS-2677: Stop of 'ora.evmd' on 'rac01' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'rac01' succeeded CRS-2677: Stop of 'ora.asm' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac01' CRS-2677: Stop of 'ora.ctssd' on 'rac01' succeeded CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac01' CRS-2677: Stop of 'ora.cssd' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.crf' on 'rac01' CRS-2677: Stop of 'ora.crf' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'rac01' CRS-2677: Stop of 'ora.gipcd' on 'rac01' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac01' CRS-2677: Stop of 'ora.gpnpd' on 'rac01' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac01' has completed CRS-4133: Oracle High Availability Services has been stopped.
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors.
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all
CRS-4639: Could not contact Oracle High Availability Services CRS-4000: Command Check failed, or completed with errors.
[root@rac01 ~]# ssh rac02 /u01/app/11.2.0.3/grid/bin/crsctl status server
NAME=rac02 STATE=ONLINE NAME=rac03 STATE=ONLINE
[root@rac01 ~]# ssh rac02 /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all
************************************************************** rac02: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rac03: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online **************************************************************
[root@rac01 ~]# ps -ef|grep grid
root 10899 10603 0 10:24 pts/1 00:00:00 grep grid
[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl stop cluster -all
CRS-2673: Attempting to stop 'ora.crsd' on 'rac02' CRS-2673: Attempting to stop 'ora.crsd' on 'rac03' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac02' CRS-2673: Attempting to stop 'ora.oc4j' on 'rac02' CRS-2673: Attempting to stop 'ora.cvu' on 'rac02' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac02' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac02' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac02' CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac02' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac03' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac03' CRS-2673: Attempting to stop 'ora.rac03.vip' on 'rac03' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac03' CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac03' CRS-2677: Stop of 'ora.rac03.vip' on 'rac03' succeeded CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac02' CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac02' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.rac02.vip' on 'rac02' CRS-2677: Stop of 'ora.scan2.vip' on 'rac02' succeeded CRS-2677: Stop of 'ora.rac02.vip' on 'rac02' succeeded CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac03' CRS-2677: Stop of 'ora.scan3.vip' on 'rac02' succeeded CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.rac01.vip' on 'rac03' CRS-2677: Stop of 'ora.scan1.vip' on 'rac03' succeeded CRS-2677: Stop of 'ora.rac01.vip' on 'rac03' succeeded CRS-2677: Stop of 'ora.oc4j' on 'rac02' succeeded CRS-2677: Stop of 'ora.cvu' on 'rac02' succeeded CRS-2677: Stop of 'ora.DATA.dg' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac02' CRS-2677: Stop of 'ora.DATA.dg' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac03' CRS-2677: Stop of 'ora.asm' on 'rac03' succeeded CRS-2677: Stop of 'ora.asm' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'rac03' CRS-2677: Stop of 'ora.ons' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac03' CRS-2677: Stop of 'ora.net1.network' on 'rac03' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac03' has completed CRS-2673: Attempting to stop 'ora.ons' on 'rac02' CRS-2677: Stop of 'ora.ons' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac02' CRS-2677: Stop of 'ora.net1.network' on 'rac02' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac02' has completed CRS-2677: Stop of 'ora.crsd' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac03' CRS-2673: Attempting to stop 'ora.evmd' on 'rac03' CRS-2673: Attempting to stop 'ora.asm' on 'rac03' CRS-2677: Stop of 'ora.crsd' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac02' CRS-2673: Attempting to stop 'ora.evmd' on 'rac02' CRS-2673: Attempting to stop 'ora.asm' on 'rac02' CRS-2677: Stop of 'ora.evmd' on 'rac03' succeeded CRS-2677: Stop of 'ora.evmd' on 'rac02' succeeded CRS-2677: Stop of 'ora.ctssd' on 'rac03' succeeded CRS-2677: Stop of 'ora.ctssd' on 'rac02' succeeded CRS-2677: Stop of 'ora.asm' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac03' CRS-2677: Stop of 'ora.asm' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac02' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac02' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac02' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac03' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac03' CRS-2677: Stop of 'ora.cssd' on 'rac02' succeeded CRS-2677: Stop of 'ora.cssd' on 'rac03' succeeded
[root@rac02 ~]# ps -ef|grep grid
root 2253 1 1 09:02 ? 00:01:02 /u01/app/11.2.0.3/grid/bin/ohasd.bin reboot grid 2491 1 0 09:02 ? 00:00:24 /u01/app/11.2.0.3/grid/bin/oraagent.bin grid 2503 1 0 09:02 ? 00:00:00 /u01/app/11.2.0.3/grid/bin/mdnsd.bin grid 2513 1 0 09:02 ? 00:00:03 /u01/app/11.2.0.3/grid/bin/gpnpd.bin grid 2524 1 0 09:02 ? 00:00:18 /u01/app/11.2.0.3/grid/bin/gipcd.bin root 2537 1 0 09:02 ? 00:00:28 /u01/app/11.2.0.3/grid/bin/orarootagent.bin root 2549 1 1 09:02 ? 00:01:19 /u01/app/11.2.0.3/grid/bin/osysmond.bin root 3367 1 1 09:04 ? 00:00:54 /u01/app/11.2.0.3/grid/bin/ologgerd -M -d /u01/app/11.2.0.3/grid/crf/db/rac02 root 8324 8022 0 10:28 pts/0 00:00:00 grep grid
[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors.
[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online CRS-4535: Cannot communicate with Cluster Ready Services CRS-4530: Communications failure contacting Cluster Synchronization Services daemon CRS-4534: Cannot communicate with Event Manager
[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac02' CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac03' CRS-2676: Start of 'ora.cssdmonitor' on 'rac02' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac02' CRS-2672: Attempting to start 'ora.diskmon' on 'rac02' CRS-2676: Start of 'ora.cssdmonitor' on 'rac03' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac03' CRS-2672: Attempting to start 'ora.diskmon' on 'rac03' CRS-2676: Start of 'ora.diskmon' on 'rac02' succeeded CRS-2676: Start of 'ora.diskmon' on 'rac03' succeeded CRS-2676: Start of 'ora.cssd' on 'rac02' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'rac02' CRS-2676: Start of 'ora.cssd' on 'rac03' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'rac03' CRS-2676: Start of 'ora.ctssd' on 'rac02' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'rac02' CRS-2676: Start of 'ora.ctssd' on 'rac03' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'rac03' CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac02' CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac03' CRS-2676: Start of 'ora.evmd' on 'rac02' succeeded CRS-2676: Start of 'ora.evmd' on 'rac03' succeeded CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac02' succeeded CRS-2672: Attempting to start 'ora.asm' on 'rac02' CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac03' succeeded CRS-2672: Attempting to start 'ora.asm' on 'rac03' CRS-2676: Start of 'ora.asm' on 'rac02' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'rac02' CRS-2676: Start of 'ora.asm' on 'rac03' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'rac03' CRS-2676: Start of 'ora.crsd' on 'rac02' succeeded CRS-2676: Start of 'ora.crsd' on 'rac03' succeeded
[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all
************************************************************** rac02: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rac03: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online **************************************************************
[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
NAME=rac02 STATE=ONLINE NAME=rac03 STATE=ONLINE
[root@rac01 ~]# ps -ef|grep grid
root 11599 2537 0 10:46 pts/0 00:00:00 grep grid [root@rac01 ~]# ssh rac02 /u01/app/11.2.0.3/grid/bin/crsctl status server
NAME=rac02 STATE=ONLINE NAME=rac03 STATE=ONLINE
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl start crs
CRS-4123: Oracle High Availability Services has been started. [root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors.
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors.
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl start cluster
CRS-4691: Oracle Clusterware is already running CRS-4000: Command Start failed, or completed with errors.
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all
************************************************************** rac01: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rac02: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rac03: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online **************************************************************
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
NAME=rac01 STATE=ONLINE NAME=rac02 STATE=ONLINE NAME=rac03 STATE=ONLINE
Now, stop and start is making me tired. Now I get to spend – go shopping.
