11.0.3.0 RAC 创建dg备库控制文件报RMAN-03002: RMAN-10038错。

Oracle RAC主库做了全备，还原控制文件：
channel d2: restoring datafile 00178 to /share/mydb/datafile/xxt108.dbf
channel d2: restoring datafile 00260 to /share/mydb/datafile/xxtidx70.dbf
channel d2: restoring datafile 00343 to /share/mydb/datafile/xxtidx83.dbf
channel d2: restoring datafile 00408 to /share/mydb/datafile/xxtidx103.dbf
channel d2: reading from backup piece bk_10932_1_910658292
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of restore command at 05/06/2016 02:11:16
RMAN-10038: database session for channel d2 terminated unexpectedly

 

查看/u01/app/oracle/diag/rdbms/phydb/phydb/trace/alertSID.log发现如下告警，感觉ASM磁盘无法正常读写。

Errors in file /u01/app/oracle/diag/rdbms/phydb/phydb/trace/phydb_rbal_6693.trc:
ORA-15183: ASMLIB initialization error [driver/agent not installed]
WARNING: FAILED to load library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so
Errors in file /u01/app/oracle/diag/rdbms/phydb/phydb/trace/phydb_rbal_6693.trc:
ORA-15183: ASMLIB initialization error [driver/agent not installed]
Wed Nov 14 18:24:14 2018
SUCCESS: diskgroup FLASH was mounted
Errors in file /u01/app/oracle/diag/rdbms/phydb/phydb/trace/phydb_ora_6743.trc  (incident=12219):
ORA-00600: internal error code, arguments: [kfioTranslateIO03], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/phydb/phydb/incident/incdir_12219/phydb_ora_6743_i12219.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Wed Nov 14 18:24:16 2018
Dumping diagnostic data in directory=[cdmp_20181114182416], requested by (instance=1, osid=6743), summary=[incident=12219].
Errors in file /u01/app/oracle/diag/rdbms/phydb/phydb/trace/phydb_ora_6743.trc  (incident=12220):
ORA-00600: internal error code, arguments: [17090], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/phydb/phydb/incident/incdir_12220/phydb_ora_6743_i12220.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Dumping diagnostic data in directory=[cdmp_20181114182417], requested by (instance=1, osid=6743), summary=[incident=12220].
ERROR: unrecoverable error ORA-600 raised in ASM I/O path; terminating process 6743

 

 

检查第一个告警文件/u01/app/oracle/diag/rdbms/phydb/phydb/trace/phydb_rbal_6693.trc

 

Trace file /u01/app/oracle/diag/rdbms/phydb/phydb/trace/phydb_rbal_6693.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Automatic Storage Management, OLAP, Data Mining
and Real Application Testing options
ORACLE_HOME = /u01/app/oracle/product/11.2.0/db_1
System name: Linux
Node name: dg.localdomain
Release: 2.6.18-194.el5
Version: #1 SMP Mon Mar 29 22:10:29 EDT 2010
Machine: x86_64
VM name: VMWare Version: 6
Instance name: phydb
Redo thread mounted by this instance: 0 <none>
Oracle process number: 15
Unix process pid: 6693, image: oracle@dg.localdomain (RBAL)

 

*** 2018-11-14 18:24:14.953
*** SESSION ID:(190.1) 2018-11-14 18:24:14.953
*** CLIENT ID:() 2018-11-14 18:24:14.953
*** SERVICE NAME:() 2018-11-14 18:24:14.953
*** MODULE NAME:() 2018-11-14 18:24:14.953
*** ACTION NAME:() 2018-11-14 18:24:14.953
 
ERROR: asm_version error. err: driver/agent not installed rc:2
ORA-15183: ASMLIB initialization error [driver/agent not installed]
ORA-15183: ASMLIB initialization error [driver/agent not installed]
kgxgnxgd: error: status 16

 

确定ASM磁盘无法读写。

 

但是/usr/sbin/oracleasm checkdisks 与asmcmd/asmca检查磁盘挂载正常。

 

百度发现文章

https://blog.csdn.net/lqx0405/article/details/44777125：

 

查看Oracle 可执行文件：

[root@node3 asm]# ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle

-r-sr-s--x 1 oracle oinstall 173515905 Apr 17 15:07  /u01/app/oracle/product/11.2.0/db_1/bin/oracle    

发现文件的所属的group错误，Oracle 后台进程启动时会执行此文件，而如果属于oinstall组，则无权访问ASM磁盘驱动，从而无法访问ASM disk。

正常属性应该是：

[oracle@node1 ~]$ ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle

-r-sr-s--x 1 oracle asmadmin 173515905 Dec 28 18:17 /u01/app/oracle/product/11.2.0/db_1/bin/oracle

修改属性：

[root@node3 ~]# chown oracle:asmadmin /u01/app/oracle/product/11.2.0/db_1/bin/oracle

[root@node3 asm]# ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle

-r-xr-x--x 1 oracle asmadmin 173515905 Apr 17 15:07 /u01/app/oracle/product/11.2.0/db_1/bin/oracle

[root@node3 asm]# chmod 6551  /u01/app/oracle/product/11.2.0/db_1/bin/oracle

[root@node3 asm]# ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle

-r-sr-s--x 1 oracle asmadmin 173515905 Apr 17 15:07 /u01/app/oracle/product/11.2.0/db_1/bin/oracle
---------------------
作者：客居天涯
来源：CSDN
原文：https://blog.csdn.net/lqx0405/article/details/44777125
版权声明：本文为博主原创文章，转载请附上博文链接！

 

备份原有oracle文件后 修改文件夹权限

 继续还原

 

 

RMAN>  restore standby controlfile from '/rman_backup/standby_1lti7cn9_1_1.ctl';

 

Starting restore at 2018/11/14 21:02:26
using channel ORA_DISK_1

 

channel ORA_DISK_1: restoring control file
channel ORA_DISK_1: restore complete, elapsed time: 00:00:07
output file name=+FLASH/cont.ctl
Finished restore at 2018/11/14 21:02:33

还原成功