欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  数据库

Oracle RAC OCR 磁盘组异常恢复

程序员文章站 2022-03-25 09:03:38
...

在11.2或者12.1的RAC中,ocr和votedisk可以放到asm中,而很多人安装系统把ocr和votedisk放到一个单独的asm 磁盘组里面,但是如果这个

在11.2或者12.1的RAC中,ocr和votedisk可以放到asm中,而很多人安装系统把ocr和votedisk放到一个单独的asm 磁盘组里面,但是如果这个磁盘组坏了,而数据所在的磁盘组是好的,这个时候该怎么恢复呢?这里的恢复分两种情况,一种是有ocr备份的恢复,另外一种是无ocr备份的恢复。但是在一般情况下ocr是每4个小时自动备份一份,因此大部分的系统中都会有ocr的备份。本blog主要对于Oracle 12c rac在有ocr备份,存储ocr,votedisk的asm磁盘组异常恢复

确定ocr,votedisk,asm spfile存在一个独立asm diskgroup中

Linux-6-64下安装Oracle 12C笔记

在CentOS 6.4下安装Oracle 11gR2(x64)

Oracle 11gR2 在VMWare虚拟机中安装步骤

Debian 下 安装 Oracle 11g XE R2

[grid@linuxidc ~]$ ocrcheck

Status of Oracle Cluster Registry is as follows :

Version : 4

Total space (kbytes) : 409568

Used space (kbytes) : 1360

Available space (kbytes) : 408208

ID : 2132096904

Device/FileName : +DG_SYS

Device/Fileintegrity check succeeded

Device/Filenot configured

Device/Filenot configured

Device/Filenot configured

Device/Filenot configured

Cluster registry integrity check succeeded

Logical corruption check bypassed due to non-privileged user

SQL> show parameter spfile;

NAME TYPE VALUE

------------------------------------ ----------- ------------------------------

spfile string +DG_SYS/xff-cluster/ASMPARAMET

ERFILE/registry.253.825628977

[grid@linuxidc ~]$ crsctl query css votedisk

## STATE File Universal Id File Name Disk group

-- ----- ----------------- --------- ---------

1. ONLINE 3e20d13ae98a4fcfbffa489ab4df68a3 (/dev/sdc2) [DG_SYS]

Located 1 voting disk(s).

ASMCMD> lsdsk -t -G dg_sys

Create_Date Mount_Date Repair_Timer Path

08-SEP-13 08-SEP-13 0 /dev/sdc2

查看当前rac状态

[grid@linuxidc ~]$ crsctl status res -t

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr

ONLINE ONLINE linuxidc STABLE

ora.DATA.dg

ONLINE ONLINE linuxidc STABLE

ora.LISTENER.lsnr

ONLINE ONLINE linuxidc STABLE

ora.net1.network

ONLINE ONLINE linuxidc STABLE

ora.ons

ONLINE ONLINE linuxidc STABLE

ora.proxy_advm

ONLINE OFFLINE linuxidc STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE linuxidc STABLE

ora.MGMTLSNR

1 ONLINE ONLINE linuxidc 169.254.196.108 10.1

0.30.22,STABLE

ora.asm

1 ONLINE ONLINE linuxidc Started,STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.cdb.db

1 ONLINE ONLINE linuxidc Open,STABLE

ora.cvu

1 ONLINE ONLINE linuxidc STABLE

ora.oc4j

1 ONLINE ONLINE linuxidc STABLE

ora.scan1.vip

1 ONLINE ONLINE linuxidc STABLE

ora.linuxidc.vip

1 ONLINE ONLINE linuxidc STABLE

--------------------------------------------------------------------------------

kfed查看磁盘头

[grid@linuxidc ~]$ kfedread /dev/sdc2

kfbh.endian: 1 ; 0x000: 0x01

kfbh.hard: 130 ; 0x001: 0x82

kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD

kfbh.datfmt: 1 ; 0x003: 0x01

kfbh.block.blk: 0 ; 0x004: blk=0

kfbh.block.obj: 2147483648 ; 0x008: disk=0

kfbh.check: 2879801080 ; 0x00c: 0xaba646f8

kfbh.fcn.base: 0 ; 0x010: 0x00000000

kfbh.fcn.wrap: 0 ; 0x014: 0x00000000

kfbh.spare1: 0 ; 0x018: 0x00000000

kfbh.spare2: 0 ; 0x01c: 0x00000000

kfdhdb.driver.provstr: ORCLDISK ; 0x000: length=8

kfdhdb.driver.reserved[0]: 0 ; 0x008: 0x00000000

kfdhdb.driver.reserved[1]: 0 ; 0x00c: 0x00000000

kfdhdb.driver.reserved[2]: 0 ; 0x010: 0x00000000

kfdhdb.driver.reserved[3]: 0 ; 0x014: 0x00000000

kfdhdb.driver.reserved[4]: 0 ; 0x018: 0x00000000

kfdhdb.driver.reserved[5]: 0 ; 0x01c: 0x00000000

kfdhdb.compat: 202375168 ; 0x020: 0x0c100000

kfdhdb.dsknum: 0 ; 0x024: 0x0000

kfdhdb.grptyp: 1 ; 0x026: KFDGTP_EXTERNAL

kfdhdb.hdrsts: 3 ; 0x027: KFDHDR_MEMBER

kfdhdb.dskname: DG_SYS_0000 ; 0x028: length=11

kfdhdb.grpname: DG_SYS ; 0x048: length=6

kfdhdb.fgname: DG_SYS_0000 ; 0x068: length=11

kfdhdb.capname: ; 0x088: length=0

kfdhdb.crestmp.hi: 32990483 ; 0x0a8: HOUR=0x13 DAYS=0x8 MNTH=0x9 YEAR=0x7dd

kfdhdb.crestmp.lo: 303455232 ; 0x0ac: USEC=0x0 MSEC=0x197 SECS=0x21 MINS=0x4

kfdhdb.mntstmp.hi: 32990485 ; 0x0b0: HOUR=0x15 DAYS=0x8 MNTH=0x9 YEAR=0x7dd

kfdhdb.mntstmp.lo: 1776845824 ; 0x0b4: USEC=0x0 MSEC=0x221 SECS=0x1e MINS=0x1a

kfdhdb.secsize: 512 ; 0x0b8: 0x0200

kfdhdb.blksize: 4096 ; 0x0ba: 0x1000

kfdhdb.ausize: 1048576 ; 0x0bc: 0x00100000

kfdhdb.mfact: 113792 ; 0x0c0: 0x0001bc80

kfdhdb.dsksize: 5451 ; 0x0c4: 0x0000154b

kfdhdb.pmcnt: 3 ; 0x0c8: 0x00000003

kfdhdb.fstlocn: 1 ; 0x0cc: 0x00000001

kfdhdb.altlocn: 2 ; 0x0d0: 0x00000002

kfdhdb.f1b1locn: 10 ; 0x0d4: 0x0000000a

kfdhdb.redomirrors[0]: 0 ; 0x0d8: 0x0000

kfdhdb.redomirrors[1]: 0 ; 0x0da: 0x0000

kfdhdb.redomirrors[2]: 0 ; 0x0dc: 0x0000

kfdhdb.redomirrors[3]: 0 ; 0x0de: 0x0000

kfdhdb.dbcompat: 168820736 ; 0x0e0: 0x0a100000

kfdhdb.grpstmp.hi: 32990483 ; 0x0e4: HOUR=0x13 DAYS=0x8 MNTH=0x9 YEAR=0x7dd

kfdhdb.grpstmp.lo: 301063168 ; 0x0e8: USEC=0x0 MSEC=0x77 SECS=0x1f MINS=0x4

kfdhdb.vfstart: 224 ; 0x0ec: 0x000000e0

kfdhdb.vfend: 256 ; 0x0f0: 0x00000100

kfdhdb.spfile: 219 ; 0x0f4: 0x000000db ----asm spfile的起点

kfdhdb.spfflg: 1 ; 0x0f8: 0x00000001

kfdhdb.flags: 1 ; 0x0fc: 0x00000001

备份ocr

[root@linuxidc xff-cluster]# ocrconfig -manualbackup

linuxidc 2013/09/0823:48:57 /u01/app/12.1/grid/product/cdata/xff-cluster/backup_20130908_234857.ocr

[root@linuxidc xff-cluster]# ocrconfig -showbackup

linuxidc 2013/08/0821:11:00 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup00.ocr

linuxidc 2013/08/0817:10:56 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup01.ocr

linuxidc 2013/07/0820:23:18 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup02.ocr

linuxidc 2013/08/0817:10:56 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/day.ocr

linuxidc 2013/08/0817:10:56 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/week.ocr

linuxidc 2013/09/0823:48:57 /u01/app/12.1/grid/product/cdata/xff-cluster/backup_20130908_234857.ocr

linuxidc 2013/06/2822:55:02 /u01/app/12.1/grid/product/cdata/xifenfe-cluster/backup_20130628_225502.ocr

破坏asm disk

[grid@linuxidc ~]$dd if=/dev/zeroof=/dev/sdc2 bs=4096 count=1

1+0 records in

1+0 records out

4096 bytes (4.1 kB) copied, 6.6061e-05 seconds, 62.0 MB/s

关闭crs

[root@linuxidc xff-cluster]# crsctl stop crs

启动crs

[root@linuxidc xff-cluster]# crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

[grid@linuxidc admin]$ crsctl status res -t -init

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

1 ONLINE OFFLINE Instance Shutdown,ST

ABLE

ora.cluster_interconnect.haip

1 ONLINE OFFLINE STABLE

ora.crf

1 ONLINE OFFLINE STABLE

ora.crsd

1 ONLINE OFFLINE STABLE

ora.cssd

1 ONLINE OFFLINE linuxidc STARTING

ora.cssdmonitor

1 ONLINE ONLINE linuxidc STABLE

ora.ctssd

1 ONLINE OFFLINE STABLE

ora.diskmon

1 OFFLINE OFFLINE STABLE

ora.drivers.acfs

1 ONLINE ONLINE linuxidc STABLE

ora.evmd

1 ONLINE INTERMEDIATE linuxidc STABLE

ora.gipcd

1 ONLINE ONLINE linuxidc STABLE

ora.gpnpd

1 ONLINE ONLINE linuxidc STABLE

ora.mdnsd

1 ONLINE ONLINE linuxidc STABLE

ora.storage

1 ONLINE OFFLINE STABLE

--------------------------------------------------------------------------------

GI相关日志

--alert日志

2013-09-08 23:53:37.662:

[gpnpd(1507)]CRS-2328:GPNPD started on node linuxidc.

2013-09-08 23:54:10.244:

[cssd(1584)]CRS-1713:CSSD daemon is startedin hub mode

2013-09-08 23:54:10.915:

[cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discoveryin 15 seconds; Details at (:CSSNM00070:)in /u01/app/12.1/grid/product/log/linuxidc/cssd/ocssd.log

2013-09-08 23:54:11.183:

[ohasd(1367)]CRS-2767:Resource state recovery not attemptedfor 'ora.diskmon'as its target state is OFFLINE

2013-09-08 23:54:11.183:

[ohasd(1367)]CRS-2769:Unable to failover resource'ora.diskmon'.

2013-09-08 23:54:26.044:

[cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discoveryin 15 seconds; Details at (:CSSNM00070:)in /u01/app/12.1/grid/product/log/linuxidc/cssd/ocssd.log

2013-09-08 23:54:41.146:

[cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discoveryin 15 seconds; Details at (:CSSNM00070:)in /u01/app/12.1/grid/product/log/linuxidc/cssd/ocssd.log

2013-09-08 23:54:56.195:

[cssd(1584)]CRS-1714:Unable to discover any voting files, retrying discoveryin 15 seconds; Details at (:CSSNM00070:)in /u01/app/12.1/grid/product/log/linuxidc/cssd/ocssd.log

--ocssd日志

2013-09-08 23:54:25.976: [ GPNP][1090226496]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2360] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote"ipc://GPNPD_linuxidc" disco ""

2013-09-08 23:54:25.976: [ CSSD][1090226496]clssnmReadDiscoveryProfile: votingfile discovery string(/dev/sd*)

2013-09-08 23:54:25.976: [ CSSD][1090226496]clssnmvDDiscThread: using discovery string/dev/sd* forinitial discovery

2013-09-08 23:54:25.976: [ SKGFD][1090226496]Discovery with str:/dev/sd*:

2013-09-08 23:54:25.976: [ SKGFD][1090226496]UFS discovery with :/dev/sd*:

2013-09-08 23:54:26.032: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdc:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdc1:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdb:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdc2:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdd:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sdd1:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sda:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sda1:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]Fetching UFS disk :/dev/sda2:

2013-09-08 23:54:26.037: [ SKGFD][1090226496]OSS discovery with :/dev/sd*:

2013-09-08 23:54:26.042: [ SKGFD][1090226496]Handle 0x1d65c10 from lib :UFS::for disk :/dev/sdb:

2013-09-08 23:54:26.043: [ SKGFD][1090226496]Handle 0x20c95a0 from lib :UFS::for disk :/dev/sdc2:

2013-09-08 23:54:26.043: [ SKGFD][1090226496]Handle 0x20c9dd0 from lib :UFS::for disk :/dev/sdd:

2013-09-08 23:54:26.044: [ SKGFD][1090226496]Lib :UFS:: closing handle 0x1d65c10for disk :/dev/sdb:

2013-09-08 23:54:26.044: [ SKGFD][1090226496]Lib :UFS:: closing handle 0x20c95a0for disk :/dev/sdc2:

2013-09-08 23:54:26.044: [ SKGFD][1090226496]Lib :UFS:: closing handle 0x20c9dd0for disk :/dev/sdd:

2013-09-08 23:54:26.044: [ CSSD][1090226496]clssnmvDiskVerify: Successful discovery of 0 disks

2013-09-08 23:54:26.044: [ CSSD][1090226496]clssnmCompleteInitVFDiscovery: Completing initial votingfile discovery

2013-09-08 23:54:26.044: [ CSSD][1090226496]clssnmvFindInitialConfigs: No voting files found

2013-09-08 23:54:26.044: [ CSSD][1090226496](:CSSNM00070:)clssnmCompleteInitVFDiscovery: Votingfile not found. Retrying discoveryin 15 seconds

在我们破坏了ocr所在的asm disk的磁盘后,启动crs明显提示无法找到votedisk信息

强制关闭crs

[root@linuxidc xff-cluster]# crsctl stop crs -f

CRS-2791: Startingshutdown of Oracle High Availability Services-managed resources on'linuxidc'

CRS-2673: Attempting to stop'ora.mdnsd' on 'linuxidc'

CRS-2673: Attempting to stop'ora.drivers.acfs' on 'linuxidc'

CRS-2677: Stop of 'ora.drivers.acfs' on 'linuxidc' succeeded

CRS-2677: Stop of 'ora.mdnsd' on 'linuxidc'succeeded

CRS-2673: Attempting to stop'ora.gpnpd' on 'linuxidc'

CRS-2673: Attempting to stop'ora.gipcd' on 'linuxidc'

CRS-2673: Attempting to stop'ora.evmd' on 'linuxidc'

CRS-2677: Stop of'ora.gpnpd' on 'linuxidc' succeeded

CRS-2677: Stop of'ora.gipcd' on 'linuxidc' succeeded

CRS-2677: Stop of'ora.evmd' on 'linuxidc' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on'linuxidc' has completed

CRS-4133: Oracle High Availability Services has been stopped.

exclusive模式启动crs

[root@linuxidc xff-cluster]# crsctl start crs -excl -nocrs

CRS-4123: Oracle High Availability Services has been started.

CRS-2673: Attempting to stop'ora.drivers.acfs' on 'linuxidc'

CRS-2677: Stop of 'ora.drivers.acfs' on 'linuxidc' succeeded

CRS-2672: Attempting to start'ora.evmd' on 'linuxidc'

CRS-2672: Attempting to start'ora.mdnsd' on 'linuxidc'

CRS-2676: Start of'ora.evmd' on 'linuxidc' succeeded

CRS-2676: Start of'ora.mdnsd' on 'linuxidc' succeeded

CRS-2672: Attempting to start'ora.gpnpd' on 'linuxidc'

CRS-2676: Start of'ora.gpnpd' on 'linuxidc' succeeded

CRS-2672: Attempting to start'ora.cssdmonitor' on 'linuxidc'

CRS-2672: Attempting to start'ora.gipcd' on 'linuxidc'

CRS-2676: Start of'ora.cssdmonitor' on 'linuxidc' succeeded

CRS-2676: Start of'ora.gipcd' on 'linuxidc' succeeded

CRS-2672: Attempting to start'ora.cssd' on 'linuxidc'

CRS-2672: Attempting to start'ora.diskmon' on'linuxidc'

CRS-2676: Start of'ora.diskmon' on'linuxidc' succeeded

CRS-2676: Start of'ora.cssd' on 'linuxidc' succeeded

CRS-2672: Attempting to start'ora.drivers.acfs' on 'linuxidc'

CRS-2672: Attempting to start'ora.cluster_interconnect.haip' on 'linuxidc'

CRS-2672: Attempting to start'ora.ctssd' on 'linuxidc'

CRS-2676: Start of'ora.ctssd' on 'linuxidc' succeeded

CRS-2676: Start of'ora.cluster_interconnect.haip' on 'linuxidc' succeeded

CRS-2676: Start of'ora.drivers.acfs' on 'linuxidc' succeeded

CRS-2672: Attempting to start'ora.asm' on 'linuxidc'

CRS-2676: Start of'ora.asm' on 'linuxidc' succeeded

[grid@linuxidc linuxidc]$ crsctl stat res -t -init

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

1 ONLINE INTERMEDIATE linuxidc OCR not started,STAB

LE

ora.cluster_interconnect.haip

1 ONLINE ONLINE linuxidc STABLE

ora.crf

1 OFFLINE OFFLINE STABLE

ora.crsd

1 OFFLINE OFFLINE STABLE

ora.cssd

1 ONLINE ONLINE linuxidc STABLE

ora.cssdmonitor

1 ONLINE ONLINE linuxidc STABLE

ora.ctssd

1 ONLINE ONLINE linuxidc ACTIVE:0,STABLE

ora.diskmon

1 OFFLINE OFFLINE STABLE

ora.drivers.acfs

1 ONLINE ONLINE linuxidc STABLE

ora.evmd

1 ONLINE INTERMEDIATE linuxidc STABLE

ora.gipcd

1 ONLINE ONLINE linuxidc STABLE

ora.gpnpd

1 ONLINE ONLINE linuxidc STABLE

ora.mdnsd

1 ONLINE ONLINE linuxidc STABLE

ora.storage

1 OFFLINE OFFLINE STABLE

创建磁盘组

[grid@linuxidc linuxidc]$ sqlplus /as sysasm

SQL*Plus: Release 12.1.0.1.0 Productionon Mon Sep 9 00:23:40 2013

Copyright (c) 1982, 2013, Oracle. All rights reserved.

Connected to:

Oracle Database12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production

With the Real Application Clustersand Automatic Storage Management options

SQL> creatediskgroup DG_OCR external redundancy disk '/dev/sdc2'attribute 'COMPATIBLE.ASM'= '12.1.0';

Diskgroup created.

[root@linuxidc xff-cluster]# ls -l

total 1472

-rw-r--r-- 1 root root 1503232 Sep 8 23:48 backup_20130908_234857.ocr

[root@linuxidc xff-cluster]# ocrconfig -restore backup_20130908_234857.ocr

PROT-35: The configured OCR locations arenot accessible

SQL> conn / as sysasm

Connected.

SQL> dropdiskgroup DG_OCR forceincluding contents;

Diskgroup dropped.

SQL> creatediskgroup DG_SYS external redundancy disk '/dev/sdc2'attribute 'COMPATIBLE.ASM'= '12.1.0';

Diskgroup created.

为了操作方便,建议创建磁盘组和以前ocr所在异常的磁盘组一致

还原ocr

[root@linuxidc xff-cluster]# ocrconfig -restore backup_20130908_234857.ocr

--ALERT 日志

2013-09-09 00:26:50.584:

[client(3015)]CRS-1002:The OCR was restored fromfile backup_20130908_234857.ocr.

处理votedisk

[root@linuxidc xff-cluster]# crsctl replace votedisk +DG_SYS

Successful addition of voting disk 60a037da30714f6bbfe5d90206ff27a7.

Successfully replaced voting disk group with +DG_SYS.

CRS-4266: Voting file(s) successfully replaced

创建asm spfile

[grid@linuxidc dbs]$vi /tmp/asm.txt

instance_type='asm'

large_pool_size=12M

remote_login_passwordfile="EXCLUSIVE"

asm_diskstring ="/dev/sd*"

asm_power_limit = 1

[grid@linuxidc dbs]$ sqlplus'/ as sysasm'

SQL*Plus: Release 12.1.0.1.0 Production on Mon Sep 9 00:34:18 2013

Copyright (c) 1982, 2013, Oracle. All rights reserved.

Connected to:

Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL> create spfile='+DG_SYS'FROM pfile='/tmp/asm.txt';

File created.

重启crs

[root@linuxidc xff-cluster]# crsctl stop crs -f

[root@linuxidc xff-cluster]# crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

[grid@linuxidc dbs]$ crsctl status res -t

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr

ONLINE ONLINE linuxidc STABLE

ora.DATA.dg

ONLINE ONLINE linuxidc STABLE

ora.LISTENER.lsnr

ONLINE ONLINE linuxidc STABLE

ora.net1.network

ONLINE ONLINE linuxidc STABLE

ora.ons

ONLINE ONLINE linuxidc STABLE

ora.proxy_advm

ONLINE OFFLINE linuxidc STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE linuxidc STABLE

ora.MGMTLSNR

1 ONLINE ONLINE linuxidc 169.254.196.108 10.1

0.30.22,STABLE

ora.asm

1 ONLINE ONLINE linuxidc Started,STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.cdb.db

1 ONLINE ONLINE linuxidc Open,STABLE

ora.cvu

1 ONLINE ONLINE linuxidc STABLE

ora.oc4j

1 ONLINE ONLINE linuxidc STABLE

ora.scan1.vip

1 ONLINE ONLINE linuxidc STABLE

ora.linuxidc.vip

1 ONLINE ONLINE linuxidc STABLE

--------------------------------------------------------------------------------

这里crs已经恢复正常,进一步检查ocr,votedisk,asm spfile情况

[grid@linuxidc ~]$ ocrcheck

Status of Oracle Cluster Registry is as follows :

Version : 4

Total space (kbytes) : 409568

Used space (kbytes) : 1380

Available space (kbytes) : 408188

ID : 2132096904

Device/FileName : +DG_SYS

Device/Fileintegrity check succeeded

Device/Filenot configured

Device/Filenot configured

Device/Filenot configured

Device/Filenot configured

Cluster registry integrity check succeeded

Logical corruption check bypassed due to non-privileged user

[grid@linuxidc ~]$ sqlplus / as sysasm

SQL*Plus: Release 12.1.0.1.0 Production on Mon Sep 9 16:12:21 2013

Copyright (c) 1982, 2013, Oracle. All rights reserved.

Connected to:

Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL> show parameter spfile;

NAME TYPE VALUE

------------------------------------ ----------- ------------------------------

spfile string +DG_SYS/xff-cluster/ASMPARAMET

ERFILE/registry.253.825640465

SQL> exit

Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.1.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

[grid@linuxidc ~]$ crsctl query css votedisk

## STATE File Universal Id File Name Disk group

-- ----- ----------------- --------- ---------

1. ONLINE 60a037da30714f6bbfe5d90206ff27a7 (/dev/sdc2) [DG_SYS]

Located 1 voting disk(s).

至此在ocr 磁盘组异常,而有ocr备份的情况下故障恢复完毕,对于没有ocr备份的故障,只能通过重建ocr来完成,,大概步骤为

--deconfigure(root)

remote node

# /crs/install/rootcrs.pl -deconfig -force -verbose

lastnode

# /crs/install/rootcrs.pl -deconfig -force -verbose -lastnode

--配置信息重建ocr等(grid)

# $GRID_HOME/crs/config/config.sh