Yarn-Resource报错: Can not find any active RM. Will retry in next 7 seconds.

报错信息

yarn-resource界面报错信息:

Can not find any active RM. Will retry in next 7 seconds. HA Zookeeper Connection State: TERMINATED

排查思路

[root@node03 zookeeperData]# netstat -nltp Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN 665/rpcbind tcp 0 0 192.168.122.1:53 0.0.0.0:* LISTEN 1439/dnsmasq tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 1155/sshd tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 1156/cupsd tcp 0 0 192.168.182.113:8088 0.0.0.0:* LISTEN 70979/java tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 1383/master tcp 0 0 127.0.0.1:40702 0.0.0.0:* LISTEN 62095/java tcp 0 0 0.0.0.0:8480 0.0.0.0:* LISTEN 62208/java tcp 0 0 192.168.182.113:8033 0.0.0.0:* LISTEN 70979/java tcp 0 0 0.0.0.0:8485 0.0.0.0:* LISTEN 62208/java tcp 0 0 0.0.0.0:9864 0.0.0.0:* LISTEN 62095/java tcp 0 0 0.0.0.0:9866 0.0.0.0:* LISTEN 62095/java tcp 0 0 0.0.0.0:9867 0.0.0.0:* LISTEN 62095/java tcp6 0 0 :::111 :::* LISTEN 665/rpcbind tcp6 0 0 192.168.182.113:3888 :::* LISTEN 70562/java tcp6 0 0 :::8080 :::* LISTEN 70562/java tcp6 0 0 :::34835 :::* LISTEN 70562/java tcp6 0 0 :::22 :::* LISTEN 1155/sshd tcp6 0 0 ::1:631 :::* LISTEN 1156/cupsd tcp6 0 0 ::1:25 :::* LISTEN 1383/master tcp6 0 0 :::2181 :::* LISTEN 70562/java tcp6 0 0 192.168.182.113:2888 :::* LISTEN 70562/java

将resourceManager关闭后发现无法启动,查看日志:

[root@node04 logs]# tail --100 hadoop-root-resourcemanager-node04.log | cat 2023-03-30 20:31:19,330 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager org.apache.hadoop.yarn.exceptions.YarnRuntimeException: RM uses DefaultResourceCalculator which used only memory as resource-type but invalid resource-types specified {resource2=name: resource2, units: , type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036854775807, memory-mb=name: memory-mb, units: Mi, type: COUNTABLE, value: 0, minimum allocation: 1024, maximum allocation: 8192, vcores=name: vcores, units: , type: COUNTABLE, value: 0, minimum allocation: 1, maximum allocation: 4, resource1=name: resource1, units: G, type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036854775807}. Use DominantResourceCalculator instead to make effective use of these resource-types at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:346) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:425) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:819) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1224) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:318) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1506) 2023-03-30 20:31:19,334 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down ResourceManager at node04/192.168.182.114 ************************************************************/

解决办法

原因:官方文档有误

需要修改的内容, 去掉官网上带的s,resources -> resource

<configuration> <property> <name>yarn.resource-type</name> <value>resource1,resource2</value> </property> <property> <name>yarn.resource-type.resource1.units</name> <value>G</value> </property> <property> <name>yarn.resource-type.resource2.minimum</name> <value>1</value> </property> <property> <name>yarn.resource-type.resource2.maximum</name> <value>1024</value> </property> </configuration>
[root@node04 hadoop]# yarn-daemon.sh start resourcemanager WARNING: Use of this script to start YARN daemons is deprecated. WARNING: Attempting to execute replacement "yarn --daemon start" instead. Last login: Thu Mar 30 20:31:17 PDT 2023 on pts/1 [root@node04 hadoop]# jps 78433 QuorumPeerMain 21152 ResourceManager 53865 DataNode 21181 Jps

__EOF__

本文作者等不到的口琴
本文链接https://www.cnblogs.com/Courage129/p/17533951.html
关于博主:评论和私信会在第一时间回复。或者直接私信我。
版权声明:本博客所有文章除特别声明外,均采用 BY-NC-SA 许可协议。转载请注明出处!
声援博主:如果您觉得文章对您有帮助,可以点击文章右下角推荐一下。您的鼓励是博主的最大动力!
posted @   等不到的口琴  阅读(893)  评论(0编辑  收藏  举报
相关博文:
阅读排行:
· 周边上新:园子的第一款马克杯温暖上架
· 分享 3 个 .NET 开源的文件压缩处理库,助力快速实现文件压缩解压功能!
· Ollama——大语言模型本地部署的极速利器
· DeepSeek如何颠覆传统软件测试?测试工程师会被淘汰吗?
· 使用C#创建一个MCP客户端
点击右上角即可分享
微信分享提示