HBase启动错误提示别的机器60000已经存在
已经用cm 安装好了cdh,需要在上面添加HBase,并且做一个HBase故障转移功能,现在需要配置2个HMaster 在不同的机器上。
启动出现异常信息:
2015-12-23 14:44:38,893 INFO org.apache.zookeeper.ZooKeeper: Session: 0x351cc5eec210013 closed 2015-12-23 14:44:38,893 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down 2015-12-23 14:44:38,895 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server node8,60000,1450853073564; all regions closed. 2015-12-23 14:44:38,916 INFO org.apache.hadoop.hbase.ipc.RpcServer: Stopping server on 60000 2015-12-23 14:44:38,926 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Node /hbase/rs/node8,60000,1450853073564 already deleted, retry=false 2015-12-23 14:44:38,937 INFO org.apache.zookeeper.ZooKeeper: Session: 0x251cc5f0a63000c closed 2015-12-23 14:44:38,937 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down 2015-12-23 14:44:38,937 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server node8,60000,1450853073564; zookeeper connection closed. 2015-12-23 14:44:38,937 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: master/node8/172.19.0.54:60000 exiting
节点启动信息:
错误原因:
在日志找到错误日志信息:
by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=hbase, access=WRITE, inode="/":hdfs:supergroup:drwxr-xr-x
错误新日志:
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-738627331-172.19.0.54-1450685235299:blk_1073741872_1048 file=/hbase/hbase.version at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:938) at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:607) at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:847) at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:199) at org.apache.hadoop.hbase.util.FSUtils.getVersion(FSUtils.java:498) at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:582) at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455) at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146) at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:126) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:611) at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:169) at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1484) at java.lang.Thread.run(Thread.java:745)
以上2个错误都用同一个办法解决
解决办法:
hadoop fs -mkdir /hbase hadoop fs -chmod 777 /hbase hadoop fs -chown hbase:hbase /hbase
org.apache.hadoop.hbase.TableExistsException: hbase:namespace
O org.apache.hadoop.hbase.master.MasterFileSystem: Log folder hdfs://nameservice1/hbase/WALs/node1,60020,1451382531829 belongs to an existing region server 2015-12-29 17:49:16,243 INFO org.apache.hadoop.hbase.master.MasterFileSystem: Log folder hdfs://nameservice1/hbase/WALs/node3,60020,1451382519808 belongs to an existing region server 2015-12-29 17:49:16,249 INFO org.apache.hadoop.hbase.master.MasterFileSystem: Log folder hdfs://nameservice1/hbase/WALs/node4,60020,1451382535204 belongs to an existing region server 2015-12-29 17:49:16,350 INFO org.apache.hadoop.hbase.master.RegionStates: Transition {1588230740 state=OFFLINE, ts=1451382556279, server=null} to {1588230740 state=OPEN, ts=1451382556350, server=node1,60020,1451382531829} 2015-12-29 17:49:16,351 INFO org.apache.hadoop.hbase.master.ServerManager: AssignmentManager hasn't finished failover cleanup; waiting 2015-12-29 17:49:16,352 INFO org.apache.hadoop.hbase.master.HMaster: hbase:meta assigned=0, rit=false, location=node1,60020,1451382531829 2015-12-29 17:49:16,432 INFO org.apache.hadoop.hbase.MetaMigrationConvertingToPB: hbase:meta doesn't have any entries to update. 2015-12-29 17:49:16,432 INFO org.apache.hadoop.hbase.MetaMigrationConvertingToPB: META already up-to date with PB serialization 2015-12-29 17:49:16,590 INFO org.apache.hadoop.hbase.master.AssignmentManager: Clean cluster startup. Assigning user regions 2015-12-29 17:49:16,674 INFO org.apache.hadoop.hbase.master.AssignmentManager: Joined the cluster in 242ms, failover=false 2015-12-29 17:49:16,708 INFO org.apache.hadoop.hbase.master.TableNamespaceManager: Namespace table not found. Creating... 2015-12-29 17:49:16,797 FATAL org.apache.hadoop.hbase.master.HMaster: Failed to become active master org.apache.hadoop.hbase.TableExistsException: hbase:namespace at org.apache.hadoop.hbase.master.handler.CreateTableHandler.checkAndSetEnablingTable(CreateTableHandler.java:152) at org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:125) at org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:233) at org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86) at org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:902) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:739) at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:169) at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1484) at java.lang.Thread.run(Thread.java:745) 2015-12-29 17:49:16,810 FATAL org.apache.hadoop.hbase.master.HMaster: Master server abort: loaded coprocessors are: [] 2015-12-29 17:49:16,810 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
解决办法:
1.切换到zookeeper的bin目录;
2.执行$sh zkCli.sh
输入 ls /
4.输入rmr /hbase
5、重启zk,重启 hbase即可