Bad check value found during backing up datafileBad check value found during backing up datafile
问题背景：
客户反馈alert日志有异常，协助排查原因
1> alert日志如下
1 Thu Jan 09 01:11:13 2020 2 Hex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc 3 Thu Jan 09 01:11:13 2020 4 Thu Jan 09 01:11:13 2020 5 Hex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99756.trcHex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99757.trc 6 7 Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) 8 Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) 9 Bad check value found during backing up datafile 10 Bad check value found during backing up datafile 11 Data in bad block: 12 Data in bad block: 13 type: 0 format: 2 rdba: 0x03e21efe 14 type: 0 format: 2 rdba: 0x03e21efe 15 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 16 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 17 spare1: 0x0 spare2: 0x0 spare3: 0x0 18 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 19 20 check value in block header: 0xba1c 21 consistency value in tail: 0x00000001 22 computed block checksum: 0x7577 23 check value in block header: 0xba1c 24 computed block checksum: 0x7577 25 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data 26 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data 27 Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) 28 Bad check value found during backing up datafile 29 Data in bad block: 30 type: 0 format: 2 rdba: 0x03e21efe 31 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 32 spare1: 0x0 spare2: 0x0 spare3: 0x0 33 consistency value in tail: 0x00000001 34 check value in block header: 0xba1c 35 computed block checksum: 0x7577 36 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data 37 Thu Jan 09 01:12:00 2020 38 Thu Jan 09 01:12:00 2020 39 Hex dump of (file 14, block 2402782) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99757.trcHex dump of (file 14, block 2402782) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc 40 41 Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782)Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782) 42 43 Bad check value found during backing up datafileBad check value found during backing up datafile 44 45 Data in bad block: 46 Data in bad block: 47 type: 0 format: 2 rdba: 0x03a4a9de 48 type: 0 format: 2 rdba: 0x03a4a9de 49 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 50 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 51 spare1: 0x0 spare2: 0x0 spare3: 0x0 52 spare1: 0x0 spare2: 0x0 spare3: 0x0 53 consistency value in tail: 0x00000001 54 consistency value in tail: 0x00000001 55 check value in block header: 0xd7a 56 check value in block header: 0xd7a 57 computed block checksum: 0x4a00 58 computed block checksum: 0x4a00 59 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data 60 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data 61 Thu Jan 09 02:00:00 2020 62 Clearing Resource Manager plan via parameter 63 Thu Jan 09 02:16:06 2020 64 Thu Jan 09 02:16:06 2020 65 Hex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_163742.trcHex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_157959.trc 66 67 Thu Jan 09 02:16:06 2020 68 Thu Jan 09 02:16:06 2020 69 Hex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_162096.trcHex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_159129.trc 70 71 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) 72 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) 73 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) 74 Bad check value found during backing up datafile 75 Data in bad block: 76 Bad check value found during backing up datafile 77 type: 6 format: 2 rdba: 0x017a57a2 78 Data in bad block: 79 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 80 type: 6 format: 2 rdba: 0x017a57a2 81 spare1: 0x0 spare2: 0x0 spare3: 0x0 82 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 83 consistency value in tail: 0x5bf10601 84 spare1: 0x0 spare2: 0x0 spare3: 0x0 85 check value in block header: 0xa735 86 consistency value in tail: 0x5bf10601 87 computed block checksum: 0x38ea 88 check value in block header: 0xa735 89 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522) 90 Bad check value found during backing up datafile computed block checksum: 0xdcae 91 92 Data in bad block: 93 Bad check value found during backing up datafile 94 type: 6 format: 2 rdba: 0x017a57a2 95 Data in bad block: 96 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 97 type: 6 format: 2 rdba: 0x017a57a2 98 spare1: 0x0 spare2: 0x0 spare3: 0x0 99 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 consistency value in tail: 0x5bf10601 100 spare1: 0x0 spare2: 0x0 spare3: 0x0 check value in block header: 0xa735 101 consistency value in tail: 0x5bf10601 computed block checksum: 0x38ea 102 103 check value in block header: 0xa735 104 computed block checksum: 0xdcae 105 Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid dataReread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data 106 Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data 107 108 Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data 109 Thu Jan 09 02:17:21 2020 110 Hex dump of (file 10, block 1328161) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_21502.trc 111 Corrupt block relative dba: 0x02944421 (file 10, block 1328161) 112 Bad check value found during backing up datafile 113 Data in bad block: 114 type: 6 format: 2 rdba: 0x02944421 115 last change scn: 0x0002.1d713b80 seq: 0x1 flg: 0x06 116 spare1: 0x0 spare2: 0x0 spare3: 0x0 117 consistency value in tail: 0x3b800601 118 check value in block header: 0x49bc 119 computed block checksum: 0x1fde 120 Reread of blocknum=1328161, file=/home/oracle/oadata/orcl04.dbf. found valid data 121 Thu Jan 09 02:21:24 2020 122 Thread 1 advanced to log sequence 1276 (LGWR switch) 123 Current log# 4 seq# 1276 mem# 0: /opt/app/oracle/oradata/orcl/redo04.log
2> 查看trc文件
[oracle@OAapp02 trace]$ more /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc Trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production With the Partitioning, OLAP, Data Mining and Real Application Testing options ORACLE_HOME = /opt/app/oracle/product/11.2.0/dbhome_1 System name: Linux Node name: OAapp02 Release: 2.6.32-642.el6.x86_64 Version: #1 SMP Tue May 10 17:27:01 UTC 2016 Machine: x86_64 Instance name: orcl Redo thread mounted by this instance: 1 Oracle process number: 335 Unix process pid: 99750, image: oracle@OAapp02 (TNS V1-V3) *** 2020-01-09 01:11:13.237 *** SESSION ID:(1897.31151) 2020-01-09 01:11:13.237 *** CLIENT ID:() 2020-01-09 01:11:13.237 *** SERVICE NAME:(SYS$USERS) 2020-01-09 01:11:13.237 *** MODULE NAME:(backup incr datafile) 2020-01-09 01:11:13.237 *** ACTION NAME:(0000020 STARTED16) 2020-01-09 01:11:13.237 Hex dump of (file 15, block 2236158) Dump of memory from 0x00007F8196521000 to 0x00007F8196523000 7F8196521000 0000A200 03E21EFE 00000000 05010000 [................] 7F8196521010 0000BA1C 00000000 00000000 00000000 [................] 7F8196521020 00000000 00000000 00000000 00000000 [................] Repeat 253 times 7F8196522000 0000A23A 00CADEF3 3C094F76 04010002 [:.......vO.<....] 7F8196522010 00007E08 00000000 00000000 00000000 [.~..............] 7F8196522020 00000000 00000000 00000000 00000000 [................] Repeat 252 times 7F8196522FF0 00000000 00000000 00000000 00000001 [................] Corrupt block relative dba: 0x03e21efe (file 15, block 2236158) Bad check value found during backing up datafile Data in bad block: type: 0 format: 2 rdba: 0x03e21efe last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 check value in block header: 0xba1c computed block checksum: 0x7577 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data *** 2020-01-09 01:12:00.412 Hex dump of (file 14, block 2402782) Dump of memory from 0x00007F81962C1000 to 0x00007F81962C3000 7F81962C1000 0000A200 03A4A9DE 00000000 05010000 [................] 7F81962C1010 00000D7A 00000000 00000000 00000000 [z...............] 7F81962C1020 00000000 00000000 00000000 00000000 [................] Repeat 261 times 7F81962C2080 00000000 34540100 0B959D5B 01FF2C00 [......T4[....,..] 7F81962C2090 002EFF80 02010054 0000800C 00000002 [....T...........] 7F81962C20A0 10000001 00CE2B2E 0000091A 00000000 [.....+..........] 7F81962C20B0 0000000A 00010000 00330032 00320033 [........2.3.3.2.] 7F81962C20C0 00000000 00000000 00000000 00000000 [................] Repeat 19 times 7F81962C2200 00000009 06000000 00000000 4E670100 [..............gN] 7F81962C2210 2C00E151 FF8001FF 00540030 800C0201 [Q..,....0.T.....] 7F81962C2220 00020000 00010000 6A2E1000 091C0044 [...........jD...] 7F81962C2230 00000000 000C0000 00000000 00310001 [..............1.] 7F81962C2240 00000000 00000000 00000000 00000000 [................] Repeat 218 times 7F81962C2FF0 00000000 00000000 00000000 00000001 [................] Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782) Bad check value found during backing up datafile Data in bad block: type: 0 format: 2 rdba: 0x03a4a9de last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001 check value in block header: 0xd7a computed block checksum: 0x4a00 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data
上述日志为数据库rman备份时检查数据文件是否有坏块所产生的日志，无需担心
