处理11gR2 RAC集群资源状态异常INTERMEDIATE,CHECK TIMED OUT
注意节点6,7的磁盘CRSDG的状态明显不正常。
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl status resource -t |less
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRSDG.dg
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
1-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
2-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
3-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
4-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
5-db-sd
ONLINE INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT
6-db-sd
ONLINE INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT
7-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
8-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
9-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw1
0-db-sd
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> srvctl stop diskgroup -g CRSDG -n ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD
PRCR-1014 : Failed to stop resource ora.CRSDG.dg
PRCR-1065 : Failed to stop resource ora.CRSDG.dg
CRS-2675: Stop of 'ora.CRSDG.dg' on 'zjhz-ps-cmread-sv-rptdw06-db-sd' failed
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> srvctl start diskgroup -g CRSDG -n ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD
PRCC-1015 : CRSDG was already running on zjhz-ps-cmread-sv-rptdw06-db-sd
PRCR-1004 : Resource ora.CRSDG.dg is already running
执行后,CHECK TIMED OUT消失,但是target变成了OFFLINE,如下所示
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl status res -t |less
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRSDG.dg
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
1-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
2-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
3-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
4-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
5-db-sd
OFFLINE ONLINE zjhz-ps-cmread-sv-rptdw0
6-db-sd
ONLINE INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT
7-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
8-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
9-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw1
0-db-sd
执行crsctl启动资源,恢复target成ONLINE
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl start resource ora.CRSDG.dg
CRS-5702: Resource 'ora.CRSDG.dg' is already running on 'zjhz-ps-cmread-sv-rptdw01-db-sd'
CRS-4000: Command Start failed, or completed with errors.
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl status res -t |less
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRSDG.dg
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
1-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
2-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
3-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
4-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
5-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
6-db-sd
ONLINE INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT
7-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
8-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw0
9-db-sd
ONLINE ONLINE zjhz-ps-cmread-sv-rptdw1
0-db-sd
节点6的资源状态恢复正常。
报错具体原因分析,可能是BUG引起的,CRS,CSS日志均无异常。
李世侠,网名caibird2005 , initdba , 战神
MySQL DBA经验6年;
Oracle DBA经验10年;
精通MySQL HA架构,复制,备份,恢复,SQL优化;
熟悉SHELL编程、Python编程、SQL&PL/SQL编程;
MySQL OCP课程讲师;
ORACLE官方认证OCM证书;
BLOG: http://www.cnblogs.com/caibird2005
http://www.initdba.cn
Wechat: caibird2005
TEL :+86-186-5881-5300 +86-180-7290-8651