KingbaseES V8R6运维案例之---归档日志批量解析

案例说明：
KingbaseES V8R6数据库的wal日志归档如果通过sys_rman工具执行，默认日志将归档在备份目录下，归档日志被压缩及日志文件名包含随机字符串，在执行sys_waldump时，必须解压缩和改名后才能被识别。

适用版本：

KingbaseES V8R6

一、数据库归档及备份配置

1、归档配置
如下所示，归档通过sys_rman执行：

[kingbase@node201 bin]$ cat ../data/es_rep.conf |grep -i archive_command
archive_command='export TZ=Asia/Shanghai;/home/kingbase/cluster/R6/R6HA/kingbase/bin/sys_rman --config /home/kingbase/kbbr_repo/sys_rman.conf --stanza=kingbase archive-push %p'

2、备份配置

二、查看归档日志文件

如下所示，归档后日志文件（没有压缩，但是名称有随机字符串）：

[kingbase@node201 0000000B00000001]$ pwd
/home/kingbase/kbbr_repo/archive/kingbase/12-1/0000000B00000001

[kingbase@node201 0000000B00000001]$ ls
0000000B00000001000000C1-3886653fdfffa873ac9e9344b5e1c57a88aa75b2
0000000B00000001000000C2-27eeb88a551b185c43aed46275ede4aeffee8be1
0000000B00000001000000C3.00000028.backup
0000000B00000001000000C3-3ffb8d25f1eb9fb9dd7dc2f287a8f7962a662e73

三、执行日志文件解析
如下所示，对于名称中包含随机字符串的日志，解析无法识别：

[kingbase@node201 0000000B00000001]$ /home/kingbase/cluster/R6/R6HA/kingbase/bin/sys_waldump 0000000B00000001000000C1-3886653fdfffa873ac9e9344b5e1c57a88aa75b2
sys_waldump: fatal: could not find file "0000000B00000001000000C1": No such file or directory

四、批量修改日志文件名（如果已压缩，需要先解压）
1、批量改名脚本（基础版）

[kingbase@node201 ~]$ cat f.sh
#!/bin/bash
ARCH_DIR='/home/kingbase/kbbr2_repo/archive/kingbase/12-1/0000000B00000001'
cd $ARCH_DIR
/bin/ls |grep -v backup|grep -v mail >/home/kingbase/f.txt
for fname in `cat /home/kingbase/f.txt`
do
#   echo  $fname
   mv $fname `echo $fname|awk -F '-' '{print $1}'`
#   /bin/ls
done

2、执行脚本改名

[kingbase@node201 ~]$ sh f.sh

# 如下所示，归档日志文件已经被改名
[kingbase@node201 ~]$ ls -lh kbbr2_repo/archive/kingbase/12-1/0000000B00000001/
total 65M
-rw-r----- 1 kingbase kingbase 16M Sep 21 18:29 0000000B00000001000000C4
-rw-r----- 1 kingbase kingbase 16M Sep 21 18:29 0000000B00000001000000C5
-rw-r----- 1 kingbase kingbase 373 Sep 21 18:30 0000000B00000001000000C5.00000028.backup
-rw-r----- 1 kingbase kingbase 16M Sep 21 18:30 0000000B00000001000000C6
-rw-r----- 1 kingbase kingbase 16M Sep 21 18:32 0000000B00000001000000C7

# 归档原文件名
[kingbase@node201 ~]$ cat f.txt
0000000B00000001000000C4-51e4d9f72f86a3265b3382e1a2ea72e44326125b
0000000B00000001000000C5-f38ce0b4d36777e12d89d303468931652e536ef8
0000000B00000001000000C6-c9936249c9e3423ae91002f3a5482283d1e4558a
0000000B00000001000000C7-a81f870590f8337d79e29460b22151873eaae277

五、执行wal日志解析

[kingbase@node201 0000000B00000001]$ /home/kingbase/cluster/R6/R6HA/kingbase/bin/sys_waldump 0000000B00000001000000C1
rmgr: XLOG        len (rec/tot):    114/   114, tx:          0, lsn: 1/C1000028, prev 1/C0020DE0, desc: CHECKPOINT_SHUTDOWN redo 1/C1000028; tli 11; prev tli 11; fpw true; xid 0:1591; oid 49342; multi 1; offset 0; oldest xid 1032 in DB 1; oldest multi 1 in DB 1; oldest/newest commit timestamp xid: 0/0; oldest running xid 0; shutdown
rmgr: Heap        len (rec/tot):     56/  1618, tx:       1591, lsn: 1/C10000A0, prev 1/C1000028, desc: INSERT off 42 flags 0x00, blkref #0: rel 1663/16385/16405 blk 8 FPW
rmgr: Transaction len (rec/tot):     34/    34, tx:       1591, lsn: 1/C10006F8, prev 1/C10000A0, desc: COMMIT 2023-09-21 17:32:08.498826 CST
rmgr: Heap        len (rec/tot):     67/   747, tx:       1592, lsn: 1/C1000720, prev 1/C10006F8, desc: HOT_UPDATE off 15 xmax 1592 flags 0x00 ; new off 16 xmax 0, blkref #0: rel 1663/16385/16388 blk 5 FPW
rmgr: Transaction len (rec/tot):     34/    34, tx:       1592, lsn: 1/C1000A10, prev 1/C1000720, desc: COMMIT 2023-09-21 17:32:08.650256 CST
........

如下图所示，可以用-p参数批量解析相关目录下wal日志：

六、总结
对于KingbaseES V8R6数据库wal日志在归档，被改名及压缩后，可以通过shell脚本，批量改名，进行wal日志的解析。