在安装GUI时，创建了第一块ASM磁盘，命名为DATA1，上面存放了spfile文件，ocrfile文件，并且作为了vote盘。感觉名字和实际不符，容易搞混，所以想删除这个磁盘，直接删除会报错：
ORA-15039: diskgroup not dropped ORA-15053: diskgroup "DATA1" contains existing files
经过查询，发现是因为这块ASM磁盘为第一块磁盘，会默认将spfile，ocrfile文件放在上面，所以需要迁移，以下为整个迁移过程，先asmca创建一块VOTE磁盘，将所有东西迁移至VOTE盘上：
[root@RAC1 bin]# export DISPLAY=192.168.137.1:0.0 [root@RAC1 bin]# xhost + access control disabled, clients can connect from any host xhost: must be on local machine to enable or disable access control. [root@RAC1 bin]# su - grid [grid@RAC1 ~]$ asmca [grid@RAC1 ~]$ asmcmd ASMCMD> lsdg State Type Rebal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name MOUNTED EXTERN N 512 4096 1048576 390144 389741 0 389741 0 Y DATA1/ MOUNTED HIGH N 512 4096 1048576 10240 9951 4096 1951 0 N VOTE/ ASMCMD> exit [grid@RAC1 ~]$ cd /u01/app/11.2.0/grid/bin/ [grid@RAC1 bin]$ ./crsctl query css votedisk; ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE ac2441da97ee4fe9bf213a4f04883ddc (/dev/mapper/mpathe) [DATA1] Located 1 voting disk(s). [grid@RAC1 bin]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 10:58:29 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> show parameter spfile; NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ spfile string +DATA1/rac-scan/asmparameterfi le/registry.253.932423991 SQL> create pfile='$ORACLE_HOME/dbs/init+ASM.ora' from spfile; File created. SQL> shutdown abort ASM instance shutdown SQL> startup pfile=$ORACLE_HOME/dbs/init+ASM.ora; ASM instance started Total System Global Area 1135747072 bytes Fixed Size 2260728 bytes Variable Size 1108320520 bytes ASM Cache 25165824 bytes ASM diskgroups mounted ASM diskgroups volume enabled SQL> show parameter spfile; NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ spfile string SQL> create spfile='+VOTE' from pfile='$ORACLE_HOME/dbs/init+ASM.ora'; File created. SQL> shutdown abort ASM instance shutdown SQL> startup ASM instance started Total System Global Area 1135747072 bytes Fixed Size 2260728 bytes Variable Size 1108320520 bytes ASM Cache 25165824 bytes ASM diskgroups mounted ASM diskgroups volume enabled SQL> show parameter spfile; NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ spfile string +VOTE/rac-scan/asmparameterfil e/registry.253.932469773 SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options [grid@RAC1 bin]$ ./crsctl query css votedisk; ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE ac2441da97ee4fe9bf213a4f04883ddc (/dev/mapper/mpathe) [DATA1] Located 1 voting disk(s). [grid@RAC1 bin]$ crsctl replace votedisk +VOTE Successful addition of voting disk 7ecf201998094fb1bf219f39752209bb. Successful addition of voting disk 86e35de49d044f23bfdebda27b7caa91. Successful addition of voting disk 52544b8c0f4e4f75bfe9d075025607ce. Successful addition of voting disk 53bfc36bc0954f39bf912f190c5788e0. Successful addition of voting disk 9b1772ca5d224f2bbfd35ce48a204777. Successful deletion of voting disk ac2441da97ee4fe9bf213a4f04883ddc. Successfully replaced voting disk group with +VOTE. CRS-4266: Voting file(s) successfully replaced [grid@RAC1 bin]$ ./crsctl query css votedisk; ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 7ecf201998094fb1bf219f39752209bb (/dev/mapper/mpathb) [VOTE] 2. ONLINE 86e35de49d044f23bfdebda27b7caa91 (/dev/mapper/mpathc) [VOTE] 3. ONLINE 52544b8c0f4e4f75bfe9d075025607ce (/dev/mapper/mpathd) [VOTE] 4. ONLINE 53bfc36bc0954f39bf912f190c5788e0 (/dev/mapper/mpathf) [VOTE] 5. ONLINE 9b1772ca5d224f2bbfd35ce48a204777 (/dev/mapper/mpathg) [VOTE] Located 5 voting disk(s). [grid@RAC1 bin]$ ./ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2760 Available space (kbytes) : 259360 ID : 1780865708 Device/File Name : +DATA1 Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user [grid@RAC1 bin]$ ./ocrconfig -add +VOTE PROT-20: Insufficient permission to proceed. Require privileged user 权限不足，需要使用root用户 [grid@RAC1 bin]$ exit logout [root@RAC1 bin]# ./ocrconfig -add +VOTE [root@RAC1 bin]# ./ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2760 Available space (kbytes) : 259360 ID : 1780865708 Device/File Name : +DATA1 Device/File integrity check succeeded Device/File Name : +VOTE Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@RAC1 bin]# ./ocrconfig -replace +DATA1 -replacement +VOTE PROT-29: The Oracle Cluster Registry location is already configured 此处报错说明已经添加进来，无法再替换 [root@RAC1 bin]# ./ocrconfig -delete +DATA1 [root@RAC1 bin]# ./ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 2760 Available space (kbytes) : 259360 ID : 1780865708 Device/File Name : +VOTE Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@RAC1 bin]# su - grid [grid@RAC1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 12:30:51 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> drop diskgroup DATA1; drop diskgroup DATA1 * ERROR at line 1: ORA-15039: diskgroup not dropped ORA-15053: diskgroup "DATA1" contains existing files SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options [grid@RAC1 ~]$ asmcmd ASMCMD> ls DATA1/ VOTE/ ASMCMD> cd DATA1 ASMCMD> ls rac-scan/ ASMCMD> rm -rf rac-scan （注意操作，千万不要误删，此处删除，是因为已经将spfile和ocrfile成功迁移至vote盘） ASMCMD> ls ASMCMD> exit [grid@RAC1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 12:32:24 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> drop diskgroup DATA1; drop diskgroup DATA1 * ERROR at line 1: ORA-15039: diskgroup not dropped ORA-15073: diskgroup DATA1 is mounted by another ASM instance 此处说明在另外一个节点，磁盘DATA1还仍处于挂载状态，需要先dismount掉： 在节点2上执行： SQL> alter diskgroup DATA1 dismount; 返回节点1 SQL> drop diskgroup DATA1; Diskgroup dropped. SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options [grid@RAC1 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....ER.lsnr ora....er.type ONLINE ONLINE rac1 ora....N1.lsnr ora....er.type ONLINE ONLINE rac2 ora.VOTE.dg ora....up.type ONLINE ONLINE rac1 ora.asm ora.asm.type ONLINE ONLINE rac1 ora.cvu ora.cvu.type ONLINE ONLINE rac1 ora.gsd ora.gsd.type OFFLINE OFFLINE ora....network ora....rk.type ONLINE ONLINE rac1 ora.oc4j ora.oc4j.type ONLINE ONLINE rac1 ora.ons ora.ons.type ONLINE ONLINE rac1 ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application OFFLINE OFFLINE ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip ora....t1.type ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application OFFLINE OFFLINE ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip ora....t1.type ONLINE ONLINE rac2 ora....ry.acfs ora....fs.type ONLINE ONLINE rac1 ora.scan1.vip ora....ip.type ONLINE ONLINE rac2 [grid@RAC1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 12:35:28 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> col path format a30 SQL> select path,mount_status from v$asm_disk; PATH MOUNT_S ------------------------------ ------- /dev/mapper/mpathh CLOSED /dev/mapper/mpathi CLOSED /dev/mapper/mpathe CLOSED /dev/mapper/mpathc CACHED /dev/mapper/mpathb CACHED /dev/mapper/mpathd CACHED /dev/mapper/mpathf CACHED /dev/mapper/mpathg CACHED 8 rows selected. 可以看到挂载的三块磁盘已经处于CLOSED状态，可用于重新创建磁盘组 SQL> create diskgroup DATA normal redundancy disk '/dev/mapper/mpathh','/dev/mapper/mpathi'; Diskgroup created. SQL> alter diskgroup DATA add disk '/dev/mapper/mpathe'; Diskgroup altered. SQL> select path,mount_status from v$asm_disk; PATH MOUNT_S ------------------------------ ------- /dev/mapper/mpathh CACHED /dev/mapper/mpathi CACHED /dev/mapper/mpathe CACHED /dev/mapper/mpathc CACHED /dev/mapper/mpathb CACHED /dev/mapper/mpathd CACHED /dev/mapper/mpathf CACHED /dev/mapper/mpathg CACHED 8 rows selected. SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options [grid@RAC1 ~]$ asmcmd ASMCMD> lsdg State Type Rebal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name MOUNTED NORMAL N 512 4096 1048576 390144 389988 130048 129970 0 N DATA/ MOUNTED HIGH N 512 4096 1048576 10240 8984 4096 1629 0 Y VOTE/
