今天就跟大家聊聊有关如何解决Linux中两块device的minor number相同而造成RAC不能启动的问题，可能很多人都不太了解，为了让大家更加了解，小编给大家总结了以下内容，希望大家根据这篇文章可以有所收获。
Oracle Linux 7.1在安装Oracle 12.2 Grid软件在执行root.sh脚本时，当第一个节点执行成功后，在第二个节点执行出现如下错误
[root@cs2 /]# ./u01/app/product/12.2.0/crs/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/product/12.2.0/crs Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /u01/app/product/12.2.0/crs/crs/install/crsconfig_params The log of current session can be found at: /u01/app/grid/crsdata/cs2/crsconfig/rootcrs_cs2_2018-03-09_04-33-22PM.log 2018/03/09 16:34:23 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2018/03/09 16:34:23 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:34:54 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:34:54 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2018/03/09 16:35:03 CLSRSC-363: User ignored prerequisites during installation 2018/03/09 16:35:03 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2018/03/09 16:35:05 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2018/03/09 16:35:06 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2018/03/09 16:35:10 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2018/03/09 16:35:12 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2018/03/09 16:35:13 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2018/03/09 16:35:16 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2018/03/09 16:35:24 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2018/03/09 16:35:24 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2018/03/09 16:35:26 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2018/03/09 16:35:42 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' 2018/03/09 16:36:42 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2018/03/09 16:38:08 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. 2018/03/09 16:38:37 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2018/03/09 16:38:39 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2' CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. 2018/03/09 16:39:07 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'cs2' CRS-2672: Attempting to start 'ora.evmd' on 'cs2' CRS-2676: Start of 'ora.mdnsd' on 'cs2' succeeded CRS-2676: Start of 'ora.evmd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'cs2' CRS-2676: Start of 'ora.gpnpd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'cs2' CRS-2676: Start of 'ora.gipcd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cs2' CRS-2676: Start of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'cs2' CRS-2672: Attempting to start 'ora.diskmon' on 'cs2' CRS-2676: Start of 'ora.diskmon' on 'cs2' succeeded CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start. CRS-4406: Oracle High Availability Services synchronous start failed. CRS-4000: Command Start failed, or completed with errors. 2018/03/09 16:39:46 CLSRSC-378: Failed to get the configured node role for the local node CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors. 2018/03/09 16:39:48 CLSRSC-117: Failed to start Oracle Clusterware stack Died at /u01/app/product/12.2.0/crs/crs/install/crsinstall.pm line 1494. The command '/u01/app/product/12.2.0/crs/perl/bin/perl -I/u01/app/product/12.2.0/crs/perl/lib -I/u01/app/product/12.2.0/crs/crs/install /u01/app/product/12.2.0/crs/crs/install/rootcrs.pl ' execution failed
出错了,如是再次执行
[root@cs2 /]# ./u01/app/product/12.2.0/crs/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/product/12.2.0/crs Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /u01/app/product/12.2.0/crs/crs/install/crsconfig_params The log of current session can be found at: /u01/app/grid/crsdata/cs2/crsconfig/rootcrs_cs2_2018-03-09_04-51-03PM.log 2018/03/09 16:51:07 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2018/03/09 16:51:07 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:51:07 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:51:08 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2018/03/09 16:51:11 CLSRSC-363: User ignored prerequisites during installation 2018/03/09 16:51:11 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2018/03/09 16:51:12 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2018/03/09 16:51:12 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2018/03/09 16:51:15 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2018/03/09 16:51:17 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2018/03/09 16:51:18 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2018/03/09 16:51:21 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2018/03/09 16:51:22 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2018/03/09 16:52:09 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2018/03/09 16:52:10 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2018/03/09 16:52:26 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' 2018/03/09 16:52:48 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2018/03/09 16:52:51 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. 2018/03/09 16:52:53 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2018/03/09 16:52:55 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2' CRS-2673: Attempting to stop 'ora.mdnsd' on 'cs2' CRS-2673: Attempting to stop 'ora.evmd' on 'cs2' CRS-2673: Attempting to stop 'ora.gpnpd' on 'cs2' CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'cs2' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'cs2' succeeded CRS-2677: Stop of 'ora.evmd' on 'cs2' succeeded CRS-2673: Attempting to stop 'ora.driver.afd' on 'cs2' CRS-2673: Attempting to stop 'ora.gipcd' on 'cs2' CRS-2677: Stop of 'ora.driver.afd' on 'cs2' succeeded CRS-2677: Stop of 'ora.gipcd' on 'cs2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. 2018/03/09 16:53:14 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'cs2' CRS-2672: Attempting to start 'ora.evmd' on 'cs2' CRS-2676: Start of 'ora.mdnsd' on 'cs2' succeeded CRS-2676: Start of 'ora.evmd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'cs2' CRS-2676: Start of 'ora.gpnpd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'cs2' CRS-2676: Start of 'ora.gipcd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cs2' CRS-2676: Start of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'cs2' CRS-2672: Attempting to start 'ora.diskmon' on 'cs2' CRS-2676: Start of 'ora.diskmon' on 'cs2' succeeded CRS-1705: Found 0 configured voting files but 1 voting files are required, terminating to ensure data integrity; details at (:CSSNM00021:) in /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start. CRS-4406: Oracle High Availability Services synchronous start failed. CRS-4000: Command Start failed, or completed with errors. 2018/03/09 16:53:53 CLSRSC-378: Failed to get the configured node role for the local node CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors. 2018/03/09 16:53:55 CLSRSC-117: Failed to start Oracle Clusterware stack Died at /u01/app/product/12.2.0/crs/crs/install/crsinstall.pm line 1494. The command '/u01/app/product/12.2.0/crs/perl/bin/perl -I/u01/app/product/12.2.0/crs/perl/lib -I/u01/app/product/12.2.0/crs/crs/install /u01/app/product/12.2.0/crs/crs/install/rootcrs.pl ' execution failed
还是出错了，但错误信息与第一次执行有所不同了，有以下内容
CRS-1705: Found 0 configured voting files but 1 voting files are required, terminating to ensure data integrity; details at (:CSSNM00021:) in /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc
如果查看跟踪文件/u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc
[root@cs2 ~]# more /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc Trace file /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc Oracle Database 12c Clusterware Release 12.2.0.1.0 - Production Copyright 1996, 2016 Oracle. All rights reserved. default:2950017088: 1: clskec:has:CLSU:910 4 args[CLSD00302][mod=clsdadr.c][loc=(:CLSD00302:)][msg=clsdAdrInit: Trace file size and number of segments fetched from environemnt variable: ORA_DAEMON_TRACE_FILE_OPTIONS filesize=52428800,n umsegments=10] CLSB:2950017088: Argument count (argc) for this daemon is 3 CLSB:2950017088: Argument 0 is: /u01/app/product/12.2.0/crs/bin/ocssd.bin CLSB:2950017088: Argument 1 is: CLSB:2950017088: Argument 2 is: OSD2PORTIF 2018-03-09 16:39:26.799 : CSSD:2950017088: (TLM) Starting CSS daemon, version 12.2.0.1.0 with uniqueness value 1520584766 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSD, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDNMC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDGMPC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDGMCC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDBCMC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDGNS, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSF, LogLevel = 0 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSFA, LogLevel = 3 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = SKGFD, LogLevel = 0 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = GPNP, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSINET, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSNS, LogLevel = 3 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = OCRAPI, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = OCRCLI, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSCEVT, LogLevel = 0 2018-03-09 16:39:26.803 : CSSD:2950017088: clssscInitGlobalCTX: not in a container CSSD:2950017088: clsugetconf : Configuration type [4]. 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscGetParameterOLR: OLR fetch for parameter auth rep (9) failed with rc 21 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscagStartAgLsnr: Failed to get auth location from OLR, constructing manually 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscagStartAgLsnr: auth location '/u01/app/product/12.2.0/crs/auth/css/' 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscGPNPInit: PERF_TIME Initializing GPNP 2018-03-09 16:39:26.810 : GPNP:2950017088: clsgpnp_Init: HMAC hash type in context is SHA-512 2018-03-09 16:39:26.810 : GPNP:2950017088: clsgpnp_Init: [at clsgpnp0.c:684] '/u01/app/product/12.2.0/crs' in effect as GPnP home base. 2018-03-09 16:39:26.810 : GPNP:2950017088: clsgpnp_Init: [at clsgpnp0.c:750] GPnP pid=29348, cli= GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:init, apitl:0, tstenv:0, devenv:0, envopt:0, flags=3 2018-03-09 16:39:26.815 : GPNP:2950017088: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:403] Using FS Wallet Location : /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.815 : GPNP:2950017088: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:415] Wallet readable. Path: /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.817 : CSSD:2782349056: clssscthrdmain: Starting thread clssscAgListener 2018-03-09 16:39:26.817 : CSSD:2782349056: clsssclsnrsetup: endp 0x6b for ipc://agent_ag_cs2_ 2018-03-09 16:39:26.817 : CSSD:2782349056: clssscagOpenAgentEndp: listening on ipc://agent_ag_cs2_ (0x6b) 2018-03-09 16:39:26.818 : CSSD:2782349056: clsssclsnrsetup: endp 0x7c for ipc://monitor_ag_cs2_ 2018-03-09 16:39:26.818 : CSSD:2782349056: clssscagOpenAgentEndp: listening on ipc://monitor_ag_cs2_ (0x7c) 2018-03-09 16:39:26.818 : CSSD:2782349056: clssscUpdateInitState: Set state to 0x00080000, based on prior state of 0x00000000 and requested change of 0x00080000 2018-03-09 16:39:26.839 : GPNP:2950017088: clsgpnp_profileCallUrlInt: [at clsgpnp.c:2238] get-profile call to url "ipc://GPNPD_cs2" disco "" [f=0 claimed- host: cname: cguid: cli:gpnp p:29348 role: seq: ep: auth: diag:[]] 2018-03-09 16:39:26.839 : default:2950017088: clsvactversion:4: Retrieving Active Version from local storage. 2018-03-09 16:39:26.842 : default:2950017088: clsvactversion:4: Retrieving Active Version from local storage. 2018-03-09 16:39:26.851 : GPNP:2950017088: clsgpnp_profileCallUrlInt: [at clsgpnp.c:2381] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_cs2" disco "" 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscGPNPInit: Successfully initialized GPNP 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: PERF_TIME starting CLSFA for Flex 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: PERF_TIME started CLSFA for Flex 2018-03-09 16:39:26.851 : CSSD:2950017088: Starting CSS daemon in big-clustered mode with a role of hub 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: Environment is production 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: Core file size limit extended 2018-03-09 16:39:26.852 : CSSD:2950017088: clssscInitGlobalCTX: GIPCHA down 0 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscqueue_init: queue(0xe708a0), max(0) 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x00080002, based on prior state of 0x00080000 and requested change of 0x00000002 2018-03-09 16:39:26.855 : CSSD:2950017088: osdctx->majik=OSD2PORTIF 2018-03-09 16:39:26.855 : CSSD:2950017088: ipmi_ipv4 = () 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscModifyWalletIP: Running as user grid 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscModifyEnvironment: unable to update wallet for IPMI 2018-03-09 16:39:26.857 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00001000, current state 0x00080002, timeout 4294967295 2018-03-09 16:39:26.858 : CLSDMT:2779895552: PID for the Process [29348], connkey CSSD 2018-03-09 16:39:26.858 : CLSDMT:2779895552: ERROR: Empty pid name for proc CSSD 2018-03-09 16:39:26.859 : CSSD:2778318592: clssscthrdmain: Starting thread Alarm 2018-03-09 16:39:26.859 : CSSD:2778318592: clssscAlarmThread: Thread Spawned 2018-03-09 16:39:26.859 : CSSD:2778318592: clssscUpdateInitState: Set state to 0x00081002, based on prior state of 0x00080002 and requested change of 0x00001000 2018-03-09 16:39:26.859 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00001000, current state 0x00081002 2018-03-09 16:39:26.859 : CSSD:2950017088: clssscqueue_init: queue(0xf1c670), max(0) 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscStartActivityThread: Waiting for INIT 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00800000, current state 0x00081002, timeout 4294967295 2018-03-09 16:39:26.860 : CSSD:2776741632: clssscthrdmain: Starting thread clssscActivityThread 2018-03-09 16:39:26.860 : CSSD:2776741632: clssscUpdateInitState: Set state to 0x00881002, based on prior state of 0x00081002 and requested change of 0x00800000 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00800000, current state 0x00881002 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscGetParameterProfile: profile fetch failed for parameter ocrid (4) with return code CLSGPNP_NOT_FOUND(5) 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscmain: OCRID is 0 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscmain: Cluster GUID is 89e968f37e66cf79bf4a5b7353e8e859 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x00881006, based on prior state of 0x00881002 and requested change of 0x00000004 2018-03-09 16:39:26.860 : CSSDBCM:2950017088: clssbcmInitialize: flags(0) 2018-03-09 16:39:26.860 : CSSDBCM:2950017088: clssbcm_SetGlobal: global(0xe69560) 2018-03-09 16:39:26.860 : CSSDBCM:2950017088: clssbcmContext: context pointer(0x7fff90720590), flags(0) 2018-03-09 16:39:26.861 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xe704c0), name(BCCM State), value(1) 2018-03-09 16:39:26.861 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xe664b0), name(BCCM Work State), value(0) 2018-03-09 16:39:26.861 : CSSDBCM:2950017088: clssbcm_NewWorkThread: Spawn status(1) 2018-03-09 16:39:26.862 : CSSD:2775164672: clssscthrdmain: Starting thread BCCM_Worker 2018-03-09 16:39:26.862 : CSSDBCM:2775164672: clssbcm_worker: Spawned with thread(0xe673f0) 2018-03-09 16:39:26.862 : CSSDBCM:2950017088: clssbcmContext: context(0xe6bb30) created 2018-03-09 16:39:26.862 : CSSDBCM:2950017088: clssbcmContext: context pointer(0x7fff90720590), flags(0) 2018-03-09 16:39:26.862 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xd07650), name(BCCM State), value(1) 2018-03-09 16:39:26.863 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xd07790), name(BCCM Work State), value(0) 2018-03-09 16:39:26.863 : CSSDBCM:2950017088: clssbcm_NewWorkThread: Spawn status(1) 2018-03-09 16:39:26.864 : CSSD:2773587712: clssscthrdmain: Starting thread BCCM_Worker 2018-03-09 16:39:26.864 : CSSDBCM:2773587712: clssbcm_worker: Spawned with thread(0xd07a90) 2018-03-09 16:39:26.864 : CSSDBCM:2950017088: clssbcmContext: context(0xd0ecd0) created 2018-03-09 16:39:26.864 : CSSDBCM:2950017088: clssbcmSetGIPCTraceLevel: context(0xe6bb30), trace(2) 2018-03-09 16:39:26.864 : CSSDBCM:2950017088: clssbcmSetGIPCTraceLevel: context(0xd0ecd0), trace(2) 2018-03-09 16:39:26.864 : CSSD:2950017088: clssscmain: PERF_TIME initializing GNS for Flex 2018-03-09 16:39:26.864 : CSSDGNS:2950017088: clssscBQInitialize: Initialized GNS Work queue 2018-03-09 16:39:26.864 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00040000, current state 0x00881006, timeout 4294967295 2018-03-09 16:39:26.865 : CSSD:2772010752: clssscthrdmain: Starting thread GNSWork 2018-03-09 16:39:26.865 : CSSD:2772010752: clssscUpdateInitState: Set state to 0x008c1006, based on prior state of 0x00881006 and requested change of 0x00040000 2018-03-09 16:39:26.866 : CLSNS:2772010752: clsns_SetTraceLevel:trace level set to 1. 2018-03-09 16:39:26.866 : CSSDGNS:2772010752: clssgnsCrsQuery: Querying CRS for resource type "ora.gns.type". 2018-03-09 16:39:26.867 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00040000, current state 0x008c1006 2018-03-09 16:39:26.867 : CSSD:2950017088: clssscmain: PERF_TIME initialized GNS for Flex 2018-03-09 16:39:26.868 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00000400, current state 0x008c1006, timeout 4294967295 2018-03-09 16:39:26.869 : CSSD:2770433792: clssscthrdmain: Starting thread BCNMServer 2018-03-09 16:39:26.869 : CSSD:2770433792: clssbnmsThread: Spawned 2018-03-09 16:39:26.869 : CSSD:2770433792: clssbnmInitBCNMCommon: Initialialization complete for comm ctx(0xd0fbb8) 2018-03-09 16:39:26.869 : CSSD:2770433792: clssscUpdateInitState: Set state to 0x008c1406, based on prior state of 0x008c1006 and requested change of 0x00000400 2018-03-09 16:39:26.869 : CSSD:2770433792: clssscWaitOnInitState: Waiting on requested state 0x00020000, current state 0x008c1406, timeout 4294967295 2018-03-09 16:39:26.871 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00000400, current state 0x008c1406 2018-03-09 16:39:26.872 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00000800, current state 0x008c1406, timeout 4294967295 2018-03-09 16:39:26.873 : CSSD:2768856832: clssscthrdmain: Starting thread BCNMClient 2018-03-09 16:39:26.873 : CSSD:2768856832: clssbnmcThread: Thread Spawned 2018-03-09 16:39:26.873 : CSSD:2768856832: clssbnmInitBCNMCommon: Initialialization complete for comm ctx(0xecc348) 2018-03-09 16:39:26.873 : CSSD:2768856832: clssscUpdateInitState: Set state to 0x008c1c06, based on prior state of 0x008c1406 and requested change of 0x00000800 2018-03-09 16:39:26.874 : CSSDGNS:2772010752: clssgnsCrsQuery: CRS is not ready. Cannot query GNS resource state. 2018-03-09 16:39:26.874 : CLSCEVT:2772010752: clsce_subscribe 0x7f568011b540 filter='^(CRS_RESOURCE_PROFILE_CHANGE|CRS_RESOURCE_STATE_CHANGE),.*?NAME='ora.gns'', flags=0, handler=0x58fa24, arg=0xd082c0 2018-03-09 16:39:26.875 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00000800, current state 0x008c1c06 2018-03-09 16:39:26.876 : CSSD:2950017088: clssscGetParameterOLR: OLR fetch for parameter node number hint (6) failed with rc 21 2018-03-09 16:39:26.886 : CSSD:2950017088: clssgmGMPInitCtx: GMP context init done 2018-03-09 16:39:26.886 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x008c1e06, based on prior state of 0x008c1c06 and requested change of 0x00000200 2018-03-09 16:39:26.887 : CLSCEVT:2772010752: (:CLSCE0022:)clsce_subscribe 0x7f568011b540 successfully subscribed : 0 2018-03-09 16:39:26.888 : CSSD:2764130048: clssscthrdmain: Starting thread GM Peer Lsnr 2018-03-09 16:39:26.888 : CSSD:2764130048: clssgmPeerListener: Spawned for node 2018-03-09 16:39:26.888 : CSSD:2764130048: clssscWaitOnInitState: Waiting on requested state 0x00000001, current state 0x008c1e06, timeout 4294967295 2018-03-09 16:39:26.890 : CSSD:2762553088: clssscthrdmain: Starting thread GMC Req Thrd 2018-03-09 16:39:26.890 : CSSD:2762553088: clssgmGMCRequestThread: Starting 2018-03-09 16:39:26.890 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMPLstnrWorkerThread, thrdnum 1 spawn success 2018-03-09 16:39:26.891 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMPLstnrWorkerThread, thrdnum 2 spawn success 2018-03-09 16:39:26.892 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMPLstnrWorkerThread, thrdnum 3 spawn success 2018-03-09 16:39:26.893 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMCReqWorkerThread, thrdnum 1 spawn success 2018-03-09 16:39:26.893 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMCReqWorkerThread, thrdnum 2 spawn success 2018-03-09 16:39:26.894 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMCReqWorkerThread, thrdnum 3 spawn success 2018-03-09 16:39:26.896 : CSSD:2760976128: clssscthrdmain: Starting thread GMPLstnrWorkerThread 2018-03-09 16:39:26.896 : CSSD:2760976128: clssgmPeerWorkerThread: thrdname GMPLstnrWorkerThread, num 35, wrkthrdnum 1 2018-03-09 16:39:26.897 : CSSD:2759399168: clssscthrdmain: Starting thread GMPLstnrWorkerThread 2018-03-09 16:39:26.897 : CSSD:2759399168: clssgmPeerWorkerThread: thrdname GMPLstnrWorkerThread, num 35, wrkthrdnum 2 2018-03-09 16:39:26.897 : CSSD:2757822208: clssscthrdmain: Starting thread GMPLstnrWorkerThread 2018-03-09 16:39:26.898 : CSSD:2757822208: clssgmPeerWorkerThread: thrdname GMPLstnrWorkerThread, num 35, wrkthrdnum 3 2018-03-09 16:39:26.899 : CSSD:2756245248: clssscthrdmain: Starting thread GMCReqWorkerThread 2018-03-09 16:39:26.899 : CSSD:2756245248: clssgmpcGMCReqWorkerThread: thrdname GMCReqWorkerThread, num 36, wrkthrdnum 1 spawned 2018-03-09 16:39:26.899 : CSSD:2754668288: clssscthrdmain: Starting thread GMCReqWorkerThread 2018-03-09 16:39:26.899 : CSSD:2754668288: clssgmpcGMCReqWorkerThread: thrdname GMCReqWorkerThread, num 36, wrkthrdnum 2 spawned 2018-03-09 16:39:26.900 : CSSD:2753091328: clssscthrdmain: Starting thread GMCReqWorkerThread 2018-03-09 16:39:26.900 : CSSD:2753091328: clssgmpcGMCReqWorkerThread: thrdname GMCReqWorkerThread, num 36, wrkthrdnum 3 spawned 2018-03-09 16:39:26.901 : CSSD:2950017088: clssscGetParameterOLR: OLR fetch for parameter auth rep (9) failed with rc 21 2018-03-09 16:39:26.901 : CSSD:2950017088: clssgmceventsub_construct: eventsub(0x13e0610), gmc(0x139adf0), name(Event Subscription Cache) 2018-03-09 16:39:26.901 : CSSD:2950017088: clssgmGMCInitCtx: GMC context init done 2018-03-09 16:39:26.902 : CSSD:2011944704: clssscthrdmain: Starting thread GMClientListener 2018-03-09 16:39:26.902 : CSSD:2011944704: clssgmclientlsnr: Spawned 2018-03-09 16:39:26.902 : CSSD:2011944704: clssscqueue_init: queue(0x7f5658032cd0), max(0) 2018-03-09 16:39:26.902 : CSSD:2011944704: clssscqueue_init: queue(0x7f5658032fd0), max(0) 2018-03-09 16:39:26.903 : CSSD:2011944704: clsssclsnrsetup: endp 0x20a for clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_cs2_)(GIPCID=00000000-00000000-29348)) 2018-03-09 16:39:26.903 : CSSD:2011944704: clssgmclientlsnr: listening on clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_cs2_)(GIPCID=00000000-00000000-29348)) 2018-03-09 16:39:26.903 : CSSD:2011944704: clssgmceventsub_construct: eventsub(0x7f565805a340), gmc(0x139adf0), name(Event Subscription Cache) 2018-03-09 16:39:26.903 : CSSD:2011944704: clssscWaitOnInitState: Waiting on requested state 0x00000001, current state 0x008c1e06, timeout 4294967295 2018-03-09 16:39:26.905 : CSSD:2010367744: clssscthrdmain: Starting thread GMDeathCheck 2018-03-09 16:39:26.905 : CSSD:2010367744: clssgmDeathChkThread: Spawned 2018-03-09 16:39:26.907 : CSSD:2008790784: clssscthrdmain: Starting thread GMPResponse 2018-03-09 16:39:26.907 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x008c1e46, based on prior state of 0x008c1e06 and requested change of 0x00000040 2018-03-09 16:39:26.908 : CSSD:2950017088: clssscGetParameterProfile: buffer passed for parameter ASM discovery (3) is too short, required 25, passed 20 2018-03-09 16:39:26.908 : CSSD:2950017088: clssnmReadDiscoveryProfile: voting file discovery string(/dev/sd*,/dev/asm*,AFD:*) 2018-03-09 16:39:26.908 : CSSD:2950017088: clssnkInit: NK generic layer initializing. 2018-03-09 16:39:26.909 : CSSD:2007213824: clssscthrdmain: Starting thread clssnmvDDiscThread 2018-03-09 16:39:26.910 : GPNP:2007213824: clsgpnp_Init: HMAC hash type in context is SHA-512 2018-03-09 16:39:26.910 : GPNP:2007213824: clsgpnp_Init: [at clsgpnp0.c:684] '/u01/app/product/12.2.0/crs' in effect as GPnP home base. 2018-03-09 16:39:26.910 : GPNP:2007213824: clsgpnp_Init: [at clsgpnp0.c:750] GPnP pid=29348, cli=clsuGpnpg GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:init, apitl:0, tstenv:0, devenv:0, envopt:0, flags=2003 2018-03-09 16:39:26.915 : GPNP:2007213824: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:403] Using FS Wallet Location : /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.915 : GPNP:2007213824: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:415] Wallet readable. Path: /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.940 : CLSF:2007213824: Allocated CLSF context 2018-03-09 16:39:26.940 : CSSD:2007213824: clssnmvDDiscThread: using discovery string /dev/sd*,/dev/asm*,AFD:* for initial discovery 2018-03-09 16:39:26.940 : SKGFD:2007213824: Discovery with str:/dev/sd*,/dev/asm*,AFD:*: 2018-03-09 16:39:26.940 : SKGFD:2007213824: UFS discovery with :/dev/sd*: 2018-03-09 16:39:26.940 : SKGFD:2007213824: Execute glob on the string /dev/sd* 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sda2 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sda1 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdc 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdb 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdf 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sde 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdd 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sda 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagSelect: endpoint(0x85) authenticated with user(root) 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcessInitialMsg: Handshake successful with agent 1 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcAgReq: got a successful connection 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcAgReq: Sending initdata 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcessInitialMsg: notify agent 1 that it is active 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcessInitialMsg: connection from agent 1, endp 0x85 - agents joined 0 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagSelect: endpoint(0x74) authenticated with user(root) 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcessInitialMsg: Handshake successful with agent 0 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcAgReq: got a successful connection 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcAgReq: Sending initdata 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcessInitialMsg: connection from agent 0, endp 0x74 - agents joined 0 2018-03-09 16:39:27.868 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:28.868 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:29.868 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sda: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sda 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdd: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdd 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sde: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sde 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdf: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdf 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdb: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdb 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdc: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdc 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sda1: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sda1 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sda2: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sda2 2018-03-09 16:39:30.689 : SKGFD:2007213824: OSS discovery with :/dev/sd*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: Discovery with asmlib :ASM:AFD Library - Generic , version 3 (KABI_V3): str :/dev/sd*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: Discovery advancing to nxt string :/dev/asm*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: UFS discovery with :/dev/asm*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: Execute glob on the string /dev/asm* 2018-03-09 16:39:30.690 : SKGFD:2007213824: running stat on disk:/dev/asm 2018-03-09 16:39:30.690 : SKGFD:2007213824: running stat on disk:/dev/asmdisk05 2018-03-09 16:39:30.692 : SKGFD:2007213824: running stat on disk:/dev/asmdisk04 2018-03-09 16:39:30.693 : SKGFD:2007213824: running stat on disk:/dev/asmdisk03 2018-03-09 16:39:30.707 : SKGFD:2007213824: running stat on disk:/dev/asmdisk02 2018-03-09 16:39:30.729 : SKGFD:2007213824: running stat on disk:/dev/asmdisk01 2018-03-09 16:39:30.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:31.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:32.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:33.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:34.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk01: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk02: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk03: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk04: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk05: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asm: 2018-03-09 16:39:35.163 : CLSF:2007213824: Ignoring 0-byte file /dev/asm 2018-03-09 16:39:35.163 : SKGFD:2007213824: OSS discovery with :/dev/asm*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: Discovery with asmlib :ASM:AFD Library - Generic , version 3 (KABI_V3): str :/dev/asm*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: Discovery advancing to nxt string :AFD:*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: UFS discovery with :AFD:*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: Execute glob on the string /u01/app/product/12.2.0/crs/dbs/AFD:* 2018-03-09 16:39:35.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:36.870 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:37.870 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:38.691 : SKGFD:2007213824: OSS discovery with :AFD:*: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Discovery with asmlib :ASM:AFD Library - Generic , version 3 (KABI_V3): str :AFD:*: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Fetching asmlib disk :AFD:CRS2: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Handle 0x7f5644337dc0 from lib :UFS:: for disk :/dev/asmdisk01: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Handle 0x7f5644338d00 from lib :UFS:: for disk :/dev/asmdisk02: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Handle 0x7f5644339c40 from lib :UFS:: for disk :/dev/asmdisk03: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Handle 0x7f564433ab80 from lib :UFS:: for disk :/dev/asmdisk04: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Handle 0x7f564433bc50 from lib :UFS:: for disk :/dev/asmdisk05: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Handle 0x7f564433cd20 from lib :ASM:AFD Library - Generic , version 3 (KABI_V3): for disk :AFD:CRS2: 2018-03-09 16:39:38.693 : CLSF:2007213824: Warning: Voting disk: /dev/asmdisk01 is Hard mounted 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f5644337dc0 for disk :/dev/asmdisk01: 2018-03-09 16:39:38.693 : CLSF:2007213824: Warning: Voting disk: /dev/asmdisk02 is Hard mounted 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f5644338d00 for disk :/dev/asmdisk02: 2018-03-09 16:39:38.693 : CLSF:2007213824: Read header of dev:/dev/asmdisk03:none: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f5644339c40 for disk :/dev/asmdisk03: 2018-03-09 16:39:38.693 : CLSF:2007213824: Read header of dev:/dev/asmdisk04:none: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f564433ab80 for disk :/dev/asmdisk04: 2018-03-09 16:39:38.702 : CLSF:2007213824: Read header of dev:/dev/asmdisk05:none: 2018-03-09 16:39:38.702 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f564433bc50 for disk :/dev/asmdisk05: 2018-03-09 16:39:38.702 : SKGFD:2007213824: Lib :ASM:AFD Library - Generic , version 3 (KABI_V3): closing handle 0x7f564433cd20 for disk :AFD:CRS2: 2018-03-09 16:39:38.702 : CSSD:2007213824: clssnmvDiskVerify: discovered a potential voting file 2018-03-09 16:39:38.702 : SKGFD:2007213824: Handle 0x7f564432fec0 from lib :UFS:: for disk :/dev/asmdisk01: 2018-03-09 16:39:38.702 : CLSF:2007213824: Opened hdl:0x7f564432e790 for dev:/dev/asmdisk01: 2018-03-09 16:39:38.702 : CSSD:2007213824: clssnmvDiskCreate: name /dev/asmdisk01 blocksz 512 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskCreate: siteid during discovery = 00000000000000000000000000000000 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskVerify: Successful discovery for disk /dev/asmdisk01, UID 750a78e1-ae984fcd-bfb4dbf4-4d337a77, SID 00112233-44556677-8899aabb- ccddeeff, Pending CIN 0:1520582274:0, Committed CIN 0 :1520582274:0 2018-03-09 16:39:38.711 : CLSF:2007213824: Closing handle:0x7f564432e790 2018-03-09 16:39:38.711 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f564432fec0 for disk :/dev/asmdisk01: 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskVerify: discovered a potential voting file 2018-03-09 16:39:38.711 : SKGFD:2007213824: Handle 0x7f564432fec0 from lib :UFS:: for disk :/dev/asmdisk02: 2018-03-09 16:39:38.711 : CLSF:2007213824: Opened hdl:0x7f564432e790 for dev:/dev/asmdisk02: 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskCreate: name /dev/asmdisk02 blocksz 512 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmvDiskCreate: siteid during discovery = 00000000000000000000000000000000 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmFindVF: found VF by vdin in the discovered queue 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(/dev/asmdisk01|[750a78e1-ae984fcd-bfb4dbf4- 4d337a77]), found(/dev/asmdisk02|[750a78e1-ae984fcd-bfb4dbf4-4d337a77]), is not corrupted 2018-03-09 16:39:38.712 : CLSF:2007213824: Resolved (/dev/asmdisk01,/dev/asmdisk02) to NONE 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmvDiskCreate: Found a duplicate voting file /dev/asmdisk01 in the discovery queue which appears to be the same physical device as the newly discovered disk /dev/asmdisk02. Rejecting bot h these files 2018-03-09 16:39:38.712 : default:2007213824: clssnmvDiskCreate:destroy_vdisk->vdisk: dump of 0x0x7f56443d3760, len 10616
发现CRS磁盘组中磁盘/dev/asmdisk01中的voting file有一份重复的副本出现在/dev/asmdisk02磁盘中，因此拒绝了这些文件。
CSSD:2007213824: clssnmvDiskCreate: Found a duplicate voting file /dev/asmdisk01 in the discovery queue which appears to be the same physical device as the newly discovered disk /dev/asmdisk02. Rejecting both these files
如是在节点cs2上查看这两块磁盘，可以看到 /dev/asmdisk01与/dev/asmdisk02的minor number都显示为32，而cs1上的/dev/asmdisk01的minor number是16,/dev/asmdisk02的minor number为32
[root@cs2 /]# ls -lrt /dev/asm* brw-rw---- 1 grid asmadmin 8, 32 Mar 9 12:21 /dev/asmdisk01 brw-rw---- 1 grid asmadmin 8, 32 Mar 9 12:23 /dev/asmdisk02 brw-rw---- 1 grid asmadmin 8, 48 Mar 9 12:23 /dev/asmdisk03 brw-rw---- 1 grid asmadmin 8, 64 Mar 9 12:23 /dev/asmdisk04 brw-rw---- 1 grid asmadmin 8, 80 Mar 9 12:23 /dev/asmdisk05 [root@cs1 /]# ls -lrt /dev/asm* brw-rw---- 1 grid asmadmin 8, 48 Mar 9 12:23 /dev/asmdisk03 brw-rw---- 1 grid asmadmin 8, 64 Mar 9 12:23 /dev/asmdisk04 brw-rw---- 1 grid asmadmin 8, 80 Mar 9 12:23 /dev/asmdisk05 brw-rw---- 1 grid asmadmin 8, 32 Mar 9 15:57 /dev/asmdisk02 brw-rw---- 1 grid asmadmin 8, 16 Mar 9 15:57 /dev/asmdisk01
如果手动删除这些用来创建asm磁盘组的块设备
[root@cs2 /]# /bin/rm /dev/asmdisk01 [root@cs2 /]# /bin/rm /dev/asmdisk02 [root@cs2 /]# /bin/rm /dev/asmdisk023 [root@cs2 /]# /bin/rm /dev/asmdisk03 [root@cs2 /]# /bin/rm /dev/asmdisk04 [root@cs2 /]# /bin/rm /dev/asmdisk05 [root@cs2 /]# ls -lrt /dev/asm* total 0
重新创建这些块设备
[root@cs2 /]# /sbin/udevadm trigger --type=devices --action=change [root@cs2 /]# ls -lrt /dev/asm* brw-rw---- 1 grid asmadmin 8, 16 Mar 9 17:37 /dev/asmdisk01 brw-rw---- 1 grid asmadmin 8, 32 Mar 9 17:37 /dev/asmdisk02 brw-rw---- 1 grid asmadmin 8, 64 Mar 9 17:37 /dev/asmdisk04 brw-rw---- 1 grid asmadmin 8, 80 Mar 9 17:37 /dev/asmdisk05 brw-rw---- 1 grid asmadmin 8, 48 Mar 9 17:37 /dev/asmdisk03 /dev/asm: total 0
再次重新执行root.sh脚本就可以执行成功
[root@cs2 /]# ./u01/app/product/12.2.0/crs/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/product/12.2.0/crs Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /u01/app/product/12.2.0/crs/crs/install/crsconfig_params The log of current session can be found at: /u01/app/grid/crsdata/cs2/crsconfig/rootcrs_cs2_2018-03-09_05-37-57PM.log 2018/03/09 17:38:01 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2018/03/09 17:38:01 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 17:38:01 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 17:38:02 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2018/03/09 17:38:05 CLSRSC-363: User ignored prerequisites during installation 2018/03/09 17:38:05 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2018/03/09 17:38:06 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2018/03/09 17:38:06 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2018/03/09 17:38:09 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2018/03/09 17:38:11 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2018/03/09 17:38:12 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2018/03/09 17:38:15 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2018/03/09 17:38:16 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2018/03/09 17:39:03 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2018/03/09 17:39:04 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2018/03/09 17:39:06 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2018/03/09 17:39:08 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. 2018/03/09 17:39:11 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2018/03/09 17:39:12 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2673: Attempting to stop 'ora.driver.afd' on 'cs2' CRS-2673: Attempting to stop 'ora.gpnpd' on 'cs2' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2' CRS-2673: Attempting to stop 'ora.gipcd' on 'cs2' CRS-2673: Attempting to stop 'ora.evmd' on 'cs2' CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'cs2' CRS-2673: Attempting to stop 'ora.mdnsd' on 'cs2' CRS-2677: Stop of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2677: Stop of 'ora.driver.afd' on 'cs2' succeeded CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'cs2' succeeded CRS-2677: Stop of 'ora.evmd' on 'cs2' succeeded CRS-2677: Stop of 'ora.gipcd' on 'cs2' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'cs2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. 2018/03/09 17:39:17 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.evmd' on 'cs2' CRS-2672: Attempting to start 'ora.mdnsd' on 'cs2' CRS-2676: Start of 'ora.mdnsd' on 'cs2' succeeded CRS-2676: Start of 'ora.evmd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'cs2' CRS-2676: Start of 'ora.gpnpd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'cs2' CRS-2676: Start of 'ora.gipcd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cs2' CRS-2676: Start of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'cs2' CRS-2672: Attempting to start 'ora.diskmon' on 'cs2' CRS-2676: Start of 'ora.diskmon' on 'cs2' succeeded CRS-2676: Start of 'ora.cssd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'cs2' CRS-2672: Attempting to start 'ora.ctssd' on 'cs2' CRS-2676: Start of 'ora.ctssd' on 'cs2' succeeded CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.asm' on 'cs2' CRS-2676: Start of 'ora.asm' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.storage' on 'cs2' CRS-2676: Start of 'ora.storage' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.crf' on 'cs2' CRS-2676: Start of 'ora.crf' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'cs2' CRS-2676: Start of 'ora.crsd' on 'cs2' succeeded CRS-6017: Processing resource auto-start for servers: cs2 CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'cs1' CRS-2672: Attempting to start 'ora.net1.network' on 'cs2' CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'cs2' CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'cs1' succeeded CRS-2676: Start of 'ora.net1.network' on 'cs2' succeeded CRS-2673: Attempting to stop 'ora.scan1.vip' on 'cs1' CRS-2672: Attempting to start 'ora.ons' on 'cs2' CRS-2677: Stop of 'ora.scan1.vip' on 'cs1' succeeded CRS-2672: Attempting to start 'ora.scan1.vip' on 'cs2' CRS-2676: Start of 'ora.scan1.vip' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'cs2' CRS-2676: Start of 'ora.ons' on 'cs2' succeeded CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.asm' on 'cs2' CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'cs2' succeeded CRS-2676: Start of 'ora.asm' on 'cs2' succeeded CRS-6016: Resource auto-start has completed for server cs2 CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources CRS-4123: Oracle High Availability Services has been started. 2018/03/09 17:42:11 CLSRSC-343: Successfully started Oracle Clusterware stack 2018/03/09 17:42:11 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'. 2018/03/09 17:42:24 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'. 2018/03/09 17:43:16 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
到此这个问题就修复了
看完上述内容，你们对如何解决Linux中两块device的minor number相同而造成RAC不能启动的问题有进一步的了解吗？如果还想了解更多知识或者相关内容，请关注亿速云行业资讯频道，感谢大家的支持。
原创文章，作者：奋斗，如若转载，请注明出处：https://blog.ytso.com/203828.html