[RAC] CRS-2640,PRCR-1079 (ASM disk group not found) problem handling
After restarting the RAC cluster, the oracle database instance did not start
[grid@rac2 ~] $crs_stat-t | grep OFFLINE
Ora.gsd ora.gsd.type OFFLINE OFFLINE
Ora.rac.db ora....se.type OFFLINE OFFLINE-- this should be ONLINE.
Ora.rac1.gsd application OFFLINE OFFLINE
Ora.rac2.gsd application OFFLINE OFFLINE
Tried to start it with the srvctl command, but it didn't work.
[grid@rac2] $srvctl start database-d rac
PRCR-1079: unable to start resource ora.rac.db
CRS-2640: the necessary resource 'ora.DATA.dg' is missing.
Check the configuration of the database and find that the DATA disk group does not exist
[grid@rac2] $srvctl config database-d rac
Unique name of the database: rac
Database name: rac
Oracle home directory: / u01/app/oracle/11.2.0/db
Oracle user: oracle
Spfile: + DATA/rac/spfilerac.ora
Domain:
Startup option: open
Stop option: immediate
Database role: PRIMARY
Management strategy: AUTOMATIC
Server pool: rac
Database example: rac1,rac2
PRCD-1012: unable to retrieve the list of disk groups for database rac.
PRCR-1035: unable to find rac's CRS resource ora.DATA.dg
PRCA-1000: ASM disk group DATA does not exist
PRCR-1001: resource ora.DATA.dg does not exist
The prompt that the DATA disk group does not exist can also be seen in the log.
Su-grid
Cd $ORACLE_HOME/log/rac1/crsd
Vi crsd.log
Based on the above information, it is inferred that there is something wrong with the DATA disk group in ASM.
Su-grid
$srvctl status diskgroup-g DATA
PRCA-1000: ASM disk group DATA does not exist
PRCR-1001: resource ora.DATA.dg does not exist
Go to asmcmd to see if it exists.
Su-grid
$asmcmd
ASMCMD > ls
DATA/-- obviously exists.
FRA/
ORC_VOTING_DISK/
After querying a lot of information, this problem occurred only when the disk group in ASM was deleted.
But I didn't delete the DATA disk group, and at last I felt hopeless. Try using umount and mount DATA disk groups in ASMCMD, and then restart the DATA disk groups using the srvctl command
$asmcmd
ASMCMD > umount data
ASMCMD > mount data
$srvctl stop diskgroup-g data-n rac1,rac2
$srvctl start diskgroup-g data-n rac1,rac2
$srvctl status diskgroup-g DATA
Disk group data is running on rac2,rac1
Start database
$srvctl start database-d rac
Check resource status, normal, problem solved.
[grid@rac2 ~] $crs_stat-t | grep OFFLINE
Ora.gsd ora.gsd.type OFFLINE OFFLINE
Ora.rac1.gsd application OFFLINE OFFLINE
Ora.rac2.gsd application OFFLINE OFFLINE
