17/11/24 05:08:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-11-24 21:20:25
1:什么叫失望,什么叫绝望。总之是一脸懵逼的继续......
之前部署的hadoop都是hadoop-2.4.1.tar.gz,这几天换成了hadoop-2.6.4.tar.gz,部署老生常谈,启动就不一样了,本来吧,也就是warn,不是error,启动hdfs和yarn,节点都可以正常启动,但是对于我这种强迫症,能容忍下面这一大推错误吗?当你看到这篇的时候,显然是不能,虽然网上已经有很多了,但是貌似好多还是不好使。我呢,也算脑补。记录一下。
[root@master hadoop]# start-dfs.sh 17/11/24 04:24:39 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. master] sed: -e expression #1, char 6: unknown option to `s' -c: Unknown cipher type 'cd' master: starting namenode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-namenode-master.out stack: ssh: connect to host stack port 22: Connection refused highly: ssh: connect to host highly port 22: Connection refused disabled: ssh: connect to host disabled port 22: Connection refused Client: ssh: connect to host Client port 22: Connection refused Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution might: ssh: Could not resolve hostname might: Temporary failure in name resolution now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution it: ssh: Could not resolve hostname it: Temporary failure in name resolution or: ssh: Could not resolve hostname or: Temporary failure in name resolution to: ssh: Could not resolve hostname to: Temporary failure in name resolution fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution You: ssh: Could not resolve hostname You: Temporary failure in name resolution <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution 'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution try: ssh: Could not resolve hostname try: Temporary failure in name resolution you: ssh: Could not resolve hostname you: Temporary failure in name resolution link: ssh: Could not resolve hostname link: Temporary failure in name resolution noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution with: ssh: connect to host with port 22: Connection refused The: ssh: connect to host The port 22: Connection refused that: ssh: Could not resolve hostname that: Temporary failure in name resolution recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution have: ssh: Could not resolve hostname have: Temporary failure in name resolution will: ssh: Could not resolve hostname will: Temporary failure in name resolution VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution library: ssh: Could not resolve hostname library: Temporary failure in name resolution with: ssh: Could not resolve hostname with: Temporary failure in name resolution guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution the: ssh: connect to host the port 22: Connection refused have: ssh: connect to host have port 22: Connection refused stack: ssh: connect to host stack port 22: Connection refused library: ssh: connect to host library port 22: Connection refused the: ssh: connect to host the port 22: Connection refused guard.: ssh: connect to host guard. port 22: Connection refused which: ssh: connect to host which port 22: Connection refused master: starting datanode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-datanode-master.out slaver1: starting datanode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-datanode-slaver1.out slaver2: starting datanode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-datanode-slaver2.out Starting secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. master] sed: -e expression #1, char 6: unknown option to `s' -c: Unknown cipher type 'cd' master: starting secondarynamenode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-secondarynamenode-master.out Client: ssh: connect to host Client port 22: Connection refused recommended: ssh: connect to host recommended port 22: Connection refused VM: ssh: connect to host VM port 22: Connection refused VM: ssh: connect to host VM port 22: Connection refused stack: ssh: connect to host stack port 22: Connection refused disabled: ssh: connect to host disabled port 22: Connection refused guard.: ssh: connect to host guard. port 22: Connection refused library: ssh: connect to host library port 22: Connection refused stack: ssh: connect to host stack port 22: Connection refused you: ssh: Could not resolve hostname you: Temporary failure in name resolution HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution to: ssh: Could not resolve hostname to: Temporary failure in name resolution You: ssh: Could not resolve hostname You: Temporary failure in name resolution 'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution link: ssh: Could not resolve hostname link: Temporary failure in name resolution It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution it: ssh: Could not resolve hostname it: Temporary failure in name resolution '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution with: ssh: connect to host with port 22: Connection refused loaded: ssh: connect to host loaded port 22: Connection refused that: ssh: connect to host that port 22: Connection refused have: ssh: connect to host have port 22: Connection refused try: ssh: Could not resolve hostname try: Temporary failure in name resolution which: ssh: connect to host which port 22: Connection refused have: ssh: connect to host have port 22: Connection refused fix: ssh: connect to host fix port 22: Connection refused the: ssh: connect to host the port 22: Connection refused guard: ssh: connect to host guard port 22: Connection refused highly: ssh: connect to host highly port 22: Connection refused library: ssh: connect to host library port 22: Connection refused fix: ssh: connect to host fix port 22: Connection refused now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution The: ssh: connect to host The port 22: Connection refused the: ssh: connect to host the port 22: Connection refused will: ssh: connect to host will port 22: Connection refused with: ssh: connect to host with port 22: Connection refused or: ssh: connect to host or port 22: Connection refused might: ssh: connect to host might port 22: Connection refused 17/11/24 04:25:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [root@master hadoop]# jps 17223 DataNode 17879 Jps 17502 SecondaryNameNode 16885 NameNode [root@master hadoop]#
上面是启动dfs的时候报的,下面是关闭dfs的时候报的:
[root@master hadoop]# stop-dfs.sh 17/11/24 05:00:36 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Stopping namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. master] sed: -e expression #1, char 6: unknown option to `s' -c: Unknown cipher type 'cd' master: stopping namenode loaded: ssh: connect to host loaded port 22: Connection refused library: ssh: connect to host library port 22: Connection refused recommended: ssh: connect to host recommended port 22: Connection refused might: ssh: connect to host might port 22: Connection refused HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution it: ssh: Could not resolve hostname it: Temporary failure in name resolution You: ssh: Could not resolve hostname You: Temporary failure in name resolution <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution link: ssh: Could not resolve hostname link: Temporary failure in name resolution now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution you: ssh: Could not resolve hostname you: Temporary failure in name resolution '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution 'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution fix: ssh: connect to host fix port 22: Connection refused the: ssh: connect to host the port 22: Connection refused with: ssh: connect to host with port 22: Connection refused to: ssh: Could not resolve hostname to: Temporary failure in name resolution Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution with: ssh: connect to host with port 22: Connection refused have: ssh: connect to host have port 22: Connection refused library: ssh: connect to host library port 22: Connection refused disabled: ssh: connect to host disabled port 22: Connection refused stack: ssh: connect to host stack port 22: Connection refused VM: ssh: connect to host VM port 22: Connection refused The: ssh: connect to host The port 22: Connection refused which: ssh: connect to host which port 22: Connection refused Client: ssh: connect to host Client port 22: Connection refused will: ssh: connect to host will port 22: Connection refused try: ssh: connect to host try port 22: Connection refused guard.: ssh: connect to host guard. port 22: Connection refused stack: ssh: connect to host stack port 22: Connection refused highly: ssh: connect to host highly port 22: Connection refused have: ssh: connect to host have port 22: Connection refused VM: ssh: connect to host VM port 22: Connection refused the: ssh: connect to host the port 22: Connection refused guard: ssh: connect to host guard port 22: Connection refused that: ssh: connect to host that port 22: Connection refused or: ssh: connect to host or port 22: Connection refused fix: ssh: connect to host fix port 22: Connection refused slaver2: stopping datanode slaver1: stopping datanode master: stopping datanode Stopping secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. master] sed: -e expression #1, char 6: unknown option to `s' -c: Unknown cipher type 'cd' master: stopping secondarynamenode Client: ssh: Could not resolve hostname Client: Temporary failure in name resolution You: ssh: Could not resolve hostname You: Temporary failure in name resolution Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution have: ssh: Could not resolve hostname have: Temporary failure in name resolution loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution library: ssh: Could not resolve hostname library: Temporary failure in name resolution have: ssh: Could not resolve hostname have: Temporary failure in name resolution disabled: ssh: Could not resolve hostname disabled: Temporary failure in name resolution The: ssh: Could not resolve hostname The: Temporary failure in name resolution highly: ssh: Could not resolve hostname highly: Temporary failure in name resolution try: ssh: Could not resolve hostname try: Temporary failure in name resolution warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution which: ssh: Could not resolve hostname which: Temporary failure in name resolution stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution the: ssh: Could not resolve hostname the: Temporary failure in name resolution will: ssh: Could not resolve hostname will: Temporary failure in name resolution It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution library: ssh: Could not resolve hostname library: Temporary failure in name resolution fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution that: ssh: Could not resolve hostname that: Temporary failure in name resolution with: ssh: Could not resolve hostname with: Temporary failure in name resolution to: ssh: Could not resolve hostname to: Temporary failure in name resolution '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution it: ssh: Could not resolve hostname it: Temporary failure in name resolution VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution the: ssh: Could not resolve hostname the: Temporary failure in name resolution 'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution or: ssh: Could not resolve hostname or: Temporary failure in name resolution link: ssh: Could not resolve hostname link: Temporary failure in name resolution you: ssh: Could not resolve hostname you: Temporary failure in name resolution noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution might: ssh: Could not resolve hostname might: Temporary failure in name resolution with: ssh: Could not resolve hostname with: Temporary failure in name resolution guard.: ssh: connect to host guard. port 22: Connection refused 17/11/24 05:02:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [root@master hadoop]#
待续.......
2:出错,解决不了,百度呗,这里贴出来,我准备百度参考的文章,不知道能不能成功呢,先记录一下,因为那是2015年,距今2年了。
http://blog.csdn.net/young_kim1/article/details/50324345
http://blog.csdn.net/young_kim1/article/details/50269501
此两篇是上下篇,希望可以帮到以后遇到这个问题的人。
3:为什么出现这个问题呢:
提示hadoop不能加载本地库。
以前官网会提供32位的安装包,但目前提供的下载包为64位的,在linux 32位系统下安装后会一直提示错误“WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable ”,但官网又不提供32位系统下的安装包,所以我们只能自己编译打包源码。
首先看下自己的虚拟机是多少位的吧:
# uname -i
通过以上命令获取系统版本,
然后呢到
大家可以到cd /home/hadoop/soft/hadoop-2.6.4/lib/native
下,查看文件libhadoop.so.1.0.0,里面会显示Hadoop的位数,官网下载好的显示是64位的,截图如下:
4:有耐心的可以根据上面的网址操作,已经写的很详细了,这里不作多叙述,直接将lib下面的native贴出来,如果你的linux是32位的,直接替换你的/lib/native即可。替换过后再查看,如下所示:
替换的32位的lib/native包:http://download.csdn.net/download/biexiansheng/10132053
启动和关闭的时候也不warn了:
停更......
2017-11-24 22:02:20