1. 查询集群 存储情况
1.查看客户端默认的Block大小 hdfs getconf -confKey dfs.blocksize 134217728=128M 2.查看指定文件的Block大小 hadoop fs -stat %o hdfs://localhost/user/harsh/file.txt 134217728=128M 3.查看当前环境已用容量 hadoop fs -du -h -s /. 2.4 G 7.6 G / 4.查看当前DataNode 整体信息 hadoop dfsadmin -report Configured Capacity: 84416008192 (78.62 GB) 配置容量 Present Capacity: 58195824640 (54.20 GB) 现在容量 = 剩余容量 + 已用容量 DFS Remaining: 55540457472 (51.73 GB) 剩余容量 DFS Used: 2655367168 (2.47 GB) 已用容量 DFS Used%: 4.56% 已用容量百分比 Replicated Blocks: Under replicated blocks: 1091 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with replication factor 1): 0 Low redundancy blocks with highest priority to recover: 1091 Pending deletion blocks: 0 Erasure Coded Block Groups: Low redundancy block groups: 0 Block groups with corrupt internal blocks: 0 Missing block groups: 0 Low redundancy blocks with highest priority to recover: 0 Pending deletion blocks: 0 ------------------------------------------------- Live datanodes (1): -- 活跃节点数 Name: 10.0.24.10:9866 (gaocun) Hostname: gaocun Decommission Status : Normal 节点状态 Configured Capacity: 84416008192 (78.62 GB) DFS Used: 2655367168 (2.47 GB) Non DFS Used: 22681788416 (21.12 GB) DFS Remaining: 55540457472 (51.73 GB) DFS Used%: 3.15% DFS Remaining%: 65.79% Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% Xceivers: 1 Last contact: Mon Mar 14 16:26:07 CST 2022 Last Block Report: Mon Mar 14 14:10:55 CST 2022 Num of Blocks: 1091 Configured Capacity: 197121124450304 (179.28 TB) Present Capacity: 183532805579324 (166.92 TB) DFS Remaining: 152495014085886 (138.69 TB) DFS Used: 31037791493438 (28.23 TB) DFS Used%: 16.91% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with replication factor 1): 0
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 10年+ .NET Coder 心语 ── 封装的思维:从隐藏、稳定开始理解其本质意义
· 地球OL攻略 —— 某应届生求职总结
· 提示词工程——AI应用必不可少的技术
· 字符编码:从基础到乱码解决
· SpringCloud带你走进微服务的世界