There are 2 missing blocks. The following files may be corrupted

There are 2 missing blocks. The following files may be corrupted：

步骤1，检查文件缺失情况

可以看到， 

blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

确实各自都丢失了1个Block， 文件已经损坏，不可恢复。

[root@master66 datacollectors]# hdfs fsck /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
Connecting to namenode via http://master66:50070
FSCK started by root (auth:SIMPLE) from /10.3.70.116 for path /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210 at Thu Sep 06 09:23:04 CST 2018
.
/var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: CORRUPT blockpool BP-1198174473-10.17.139.66-1492053574238 block blk_1074785806

/var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210: MISSING 1 blocks of total size 41235 B.Status: CORRUPT
 Total size:    41235 B
 Total dirs:    0
 Total files:    1
 Total symlinks:        0
 Total blocks (validated):    1 (avg. block size 41235 B)
  ********************************
  CORRUPT FILES:    1
  MISSING BLOCKS:    1
  MISSING SIZE:        41235 B
  CORRUPT BLOCKS:     1
  ********************************
 Minimally replicated blocks:    0 (0.0 %)
 Over-replicated blocks:    0 (0.0 %)
 Under-replicated blocks:    0 (0.0 %)
 Mis-replicated blocks:        0 (0.0 %)
 Default replication factor:    1
 Average block replication:    0.0
 Corrupt blocks:        1
 Missing replicas:        0
 Number of data-nodes:        1
 Number of racks:        1
FSCK ended at Thu Sep 06 09:23:04 CST 2018 in 1 milliseconds


The filesystem under path '/var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210' is CORRUPT

步骤2，删除缺失文件

hdfs fsck -delete blk_1074785806 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4290/master66_38210
hdfs fsck -delete blk_1074785807 /var/log/yarn_hislog/yarn/apps/root/logs/application_1531830253305_4289/master66_38210

步骤3， 检查集群健康状况

 

posted @ 2018-09-06 09:33  大葱拌豆腐  阅读(4094)  评论(0)  编辑  收藏  举报