Apache HDFS Federation + HA 部署实战案例

　　　　　　　　　　　　　Apache HDFS Federation + HA 部署实战案例

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　作者：尹正杰

版权声明：原创作品，谢绝转载！否则将追究法律责任。

 

 

 

一.Apache HDFS Federation架构设计

1>.NameNode架构的局限性

　　Namespace(命名空间)的限制
　　　　由于NameNode在内存中存储所有的元数据（metadata），因此单个NameNode所能存储的对象（文件+块）数目受到NameNode所在JVM的heap size的限制。50G的heap能够存储20亿（200million）个对象，这20亿个对象支持4000个DataNode，12PB的存储（假设文件平均大小为40MB）。随着数据的飞速增长，存储的需求也随之增长。单个DataNode从4T增长到36T，集群的尺寸增长到8000个DataNode。存储的需求从12PB增长到大于100PB。

　　隔离问题
　　　　由于HDFS仅有一个NameNode，无法隔离各个程序，因此HDFS上的一个实验程序就很有可能影响整个HDFS上运行的程序。

　　性能的瓶颈
　　　　由于是单个NameNode的HDFS架构，因此整个HDFS文件系统的吞吐量受限于单个NameNode的吞吐量。

2>.HDFS Federation架构设计

　　为了水平扩展名称服务，联合会使用多个独立的Namenodes /命名空间。名称节点是联合的；Namenode是独立的，不需要相互协调。数据节点被所有名称节点用作块的公共存储。每个Datanode向集群中的所有Namenode注册。数据节点定期发送心跳并阻止报告。他们还处理来自Namenodes的命令。
　　用户可以使用ViewF创建个性化的名称空间视图。ViewFs类似于某些Unix / Linux系统中的客户端挂载表。

　　区块池(Block Pool):
　　　　块池是一组属于单个名称空间的块。数据节点存储集群中所有块池的块。每个块池都是独立管理的。这允许命名空间为新块生成块ID，而无需与其他命名空间进行协调。Namenode故障不会阻止Datanode服务群集中的其他Namenode。
　　　　命名空间及其块池一起称为“命名空间卷”。它是一个独立的管理部门。删除名称节点/名称空间后，将删除数据节点上的相应块池。在群集升级期间，每个名称空间卷都作为一个单元升级。

　　集群ID(ClusterID):
　　　　甲丛集编号标识用于识别该集群中的所有节点。格式化Namenode时，将提供此标识符或自动生成该标识符。该ID应该用于将其他Namenode格式化为集群。

3>.HDFS Federation

　　不同应用可以使用不同NameNode进行数据管理，图片业务、爬虫业务、日志审计业务。

　　Hadoop生态系统中，不同的框架使用不同的NameNode进行管理NameSpace(隔离性)。

　　博主推荐阅读:
　　　　http://hadoop.apache.org/docs/r2.10.0/hadoop-project-dist/hadoop-hdfs/Federation.html

 

二.试验环境说明

1>.角色分配

[root@hadoop101.yinzhengjie.org.cn ~]# ansible all -m shell -a 'jps'
hadoop101.yinzhengjie.org.cn | SUCCESS | rc=0 >>
8736 DataNode
5851 NameNode
7099 ZooKeeperMain
7660 DFSZKFailoverController
6893 QuorumPeerMain
10095 Jps

hadoop106.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5629 NameNode
6285 DataNode
6637 Jps
6095 DFSZKFailoverController

hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6450 Jps
5683 DFSZKFailoverController
6152 DataNode
4442 NameNode
5018 JournalNode
5244 QuorumPeerMain

hadoop104.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5024 Jps
4801 DataNode
4586 JournalNode

hadoop103.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5297 Jps
4788 QuorumPeerMain
5077 DataNode
4573 JournalNode

hadoop105.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6193 NameNode
7395 Jps
6906 DFSZKFailoverController
7082 DataNode

[root@hadoop101.yinzhengjie.org.cn ~]# 

2>.ns1公用的配置文件

[root@hadoop101.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# cat hdfs-site.xml 
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

    <!--配置NameSpace列表,此处我们仅配置2个NameNode -->
    <property>
    <name>dfs.nameservices</name>
    <value>ns1,ns2</value>
        <description>用逗号分隔的NameServiceID列表进行配置,Datanode将使用它来确定集群中的Namenode。</description>
    </property>

    <!-- *************** 配置ns1 *************** -->
    <property>
    <name>dfs.ha.namenodes.ns1</name>
    <value>nn1,nn2</value>
        <description>指定ns1名称空间的中NameNode节点别名</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns1.nn1</name>
    <value>hadoop101.yinzhengjie.org.cn:9000</value>
        <description>指定nn1别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns1.nn2</name>
    <value>hadoop102.yinzhengjie.org.cn:9000</value>
        <description>指定nn2别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.http-address.ns1.nn1</name>
    <value>hadoop101.yinzhengjie.org.cn:50070</value>
        <description>指定nn1别名对应的真实WebUI地址(即http通信地址)</description>
    </property>
  
    <property>
    <name>dfs.namenode.http-address.ns1.nn2</name>
    <value>hadoop102.yinzhengjie.org.cn:50070</value>
        <description>指定nn2别名对应的真实WebUI地址(即http通信地址)</description>
    </property>

    <property>
      <name>dfs.client.failover.proxy.provider.ns1</name>
    <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
        <description>访问代理类,active配置失败自动切换实现方式</description>
    </property>

    <!-- *************** 配置ns2 *************** -->

    <property>
    <name>dfs.ha.namenodes.ns2</name>
    <value>nn5,nn6</value>
        <description>指定ns2名称空间的中NameNode节点别名</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns2.nn5</name>
    <value>hadoop105.yinzhengjie.org.cn:9000</value>
        <description>指定nn5别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns2.nn6</name>
    <value>hadoop106.yinzhengjie.org.cn:9000</value>
        <description>指定nn6别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.http-address.ns2.nn5</name>
    <value>hadoop105.yinzhengjie.org.cn:50070</value>
        <description>指定nn5别名对应的真实WebUI地址(即http通信地址)</description>
    </property>
  
    <property>
    <name>dfs.namenode.http-address.ns2.nn6</name>
    <value>hadoop106.yinzhengjie.org.cn:50070</value>
        <description>指定nn6别名对应的真实WebUI地址(即http通信地址)</description>
    </property>

    <property>
      <name>dfs.client.failover.proxy.provider.ns2</name>
    <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
        <description>访问代理类,active配置失败自动切换实现方式</description>
    </property>


    <!-- *************** 注意journalnode集群对应的ns1和ns2的配置是不一样的,此配置是ns1的编辑日志 *************** -->
    <property>
    <name>dfs.namenode.shared.edits.dir</name>
    <value>qjournal://hadoop103.yinzhengjie.org.cn:8485;hadoop104.yinzhengjie.org.cn:8485;hadoop102.yinzhengjie.org.cn:8485/ns1</value>
        <description>指定NameNode元数据在JournalNode集群上的存放位置</description>
    </property>

    <!-- *************** 以下配置是通用配置 *************** -->

    <property>
        <name>dfs.journalnode.edits.dir</name>
        <value>/yinzhengjie/data/hdfs/federation/edits</value>
        <description>声明journalnode服务器本地存储目录</description>
    </property>

    <property>
        <name>dfs.replication</name>
        <value>3</value>
        <description>指定HDFS副本的数量</description>
    </property>

    <property>
    <name>dfs.ha.fencing.methods</name>
    <value>sshfence</value>
        <description>配置隔离机制，即同一时刻只能有一台服务器对外响应</description>
    </property>

    <property>
    <name>dfs.ha.fencing.ssh.private-key-files</name>
    <value>/root/.ssh/id_rsa</value>
        <description>使用sshfence隔离机制时需要ssh无秘钥登录</description>
    </property>

    <property>
    <name>dfs.ha.automatic-failover.enabled</name>
    <value>true</value>
        <description>启动自动容灾功能</description>
    </property>

</configuration>
[root@hadoop101.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# 

3>.ns2公用的配置文件

[root@hadoop105.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# cat hdfs-site.xml 
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

    <!--配置NameSpace列表,此处我们仅配置2个NameNode -->
    <property>
    <name>dfs.nameservices</name>
    <value>ns1,ns2</value>
        <description>用逗号分隔的NameServiceID列表进行配置,Datanode将使用它来确定集群中的Namenode。</description>
    </property>

    <!-- *************** 配置ns1 *************** -->
    <property>
    <name>dfs.ha.namenodes.ns1</name>
    <value>nn1,nn2</value>
        <description>指定ns1名称空间的中NameNode节点别名</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns1.nn1</name>
    <value>hadoop101.yinzhengjie.org.cn:9000</value>
        <description>指定nn1别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns1.nn2</name>
    <value>hadoop102.yinzhengjie.org.cn:9000</value>
        <description>指定nn2别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.http-address.ns1.nn1</name>
    <value>hadoop101.yinzhengjie.org.cn:50070</value>
        <description>指定nn1别名对应的真实WebUI地址(即http通信地址)</description>
    </property>
  
    <property>
    <name>dfs.namenode.http-address.ns1.nn2</name>
    <value>hadoop102.yinzhengjie.org.cn:50070</value>
        <description>指定nn2别名对应的真实WebUI地址(即http通信地址)</description>
    </property>

    <property>
      <name>dfs.client.failover.proxy.provider.ns1</name>
    <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
        <description>访问代理类,active配置失败自动切换实现方式</description>
    </property>

    <!-- *************** 配置ns2 *************** -->

    <property>
    <name>dfs.ha.namenodes.ns2</name>
    <value>nn5,nn6</value>
        <description>指定ns2名称空间的中NameNode节点别名</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns2.nn5</name>
    <value>hadoop105.yinzhengjie.org.cn:9000</value>
        <description>指定nn5别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.rpc-address.ns2.nn6</name>
    <value>hadoop106.yinzhengjie.org.cn:9000</value>
        <description>指定nn6别名对应的真实主机及端口(绑定RPC通信地址),即您可以理解添加映射关系.</description>
    </property>

    <property>
    <name>dfs.namenode.http-address.ns2.nn5</name>
    <value>hadoop105.yinzhengjie.org.cn:50070</value>
        <description>指定nn5别名对应的真实WebUI地址(即http通信地址)</description>
    </property>
  
    <property>
    <name>dfs.namenode.http-address.ns2.nn6</name>
    <value>hadoop106.yinzhengjie.org.cn:50070</value>
        <description>指定nn6别名对应的真实WebUI地址(即http通信地址)</description>
    </property>

    <property>
      <name>dfs.client.failover.proxy.provider.ns2</name>
    <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
        <description>访问代理类,active配置失败自动切换实现方式</description>
    </property>


    <!-- *************** 注意journalnode集群对应的ns1和ns2的配置是不一样的,此配置是ns1的编辑日志 *************** -->
    <property>
    <name>dfs.namenode.shared.edits.dir</name>
    <value>qjournal://hadoop103.yinzhengjie.org.cn:8485;hadoop104.yinzhengjie.org.cn:8485;hadoop102.yinzhengjie.org.cn:8485/ns2</value>
        <description>指定NameNode元数据在JournalNode集群上的存放位置</description>
    </property>

    <!-- *************** 以下配置是通用配置 *************** -->

    <property>
        <name>dfs.journalnode.edits.dir</name>
        <value>/yinzhengjie/data/hdfs/federation/edits</value>
        <description>声明journalnode服务器本地存储目录</description>
    </property>

    <property>
        <name>dfs.replication</name>
        <value>3</value>
        <description>指定HDFS副本的数量</description>
    </property>

    <property>
    <name>dfs.ha.fencing.methods</name>
    <value>sshfence</value>
        <description>配置隔离机制，即同一时刻只能有一台服务器对外响应</description>
    </property>

    <property>
    <name>dfs.ha.fencing.ssh.private-key-files</name>
    <value>/root/.ssh/id_rsa</value>
        <description>使用sshfence隔离机制时需要ssh无秘钥登录</description>
    </property>

    <property>
    <name>dfs.ha.automatic-failover.enabled</name>
    <value>true</value>
        <description>启动自动容灾功能</description>
    </property>

</configuration>
[root@hadoop105.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# 

4>.公用的配置文件

[root@hadoop105.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# cat core-site.xml 
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<configuration  xmlns:xi="http://www.w3.org/2001/XInclude"> 

    <!-- 加载该文件同目录下的 "mountTable.xml" 文件 -->
    <xi:include href="mountTable.xml" />
    
    <property>
        <name>fs.defaultFS</name>
        <value>viewfs://yinzhengjie-hdfs</value>
        <description>自定义HDFS集群的逻辑名称</description>
    </property>

    <property>
        <name>hadoop.tmp.dir</name>
        <value>/yinzhengjie/data/hdfs/federation/data</value>
        <description>指定Hadoop运行时产生文件的存储目录</description>
    </property>

    <property>
    <name>ha.zookeeper.quorum</name>
    <value>hadoop101.yinzhengjie.org.cn:2181,hadoop102.yinzhengjie.org.cn:2181,hadoop103.yinzhengjie.org.cn:2181</value>
        <description>指定zookeeper集群的地址</description>
    </property>


</configuration>
[root@hadoop105.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# 

[root@hadoop105.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# cat mountTable.xml 
<configuration>
    <property>
        <name>fs.viewfs.mounttable.yinzhengjie-hdfs.homedir</name>
        <value>/home</value>
                <description>指定集群的家目录</description>
    </property>
    <property>
        <name>fs.viewfs.mounttable.yinzhengjie-hdfs.link./home</name>
        <value>hdfs://ns1/home</value>
    </property>
    <property>
        <name>fs.viewfs.mounttable.yinzhengjie-hdfs.link./tmp</name>
        <value>hdfs://ns2/tmp</value>
    </property>
    <property>
        <name>fs.viewfs.mounttable.yinzhengjie-hdfs.link./projects/foo</name>
        <value>hdfs://ns1/projects/foo</value>
    </property>
    <property>
        <name>fs.viewfs.mounttable.yinzhengjie-hdfs.link./projects/bar</name>
        <value>hdfs://ns2/projects/bar</value>
    </property>
</configuration>
[root@hadoop105.yinzhengjie.org.cn /yinzhengjie/softwares/federation/etc/hadoop]# 

5>.特别说明

　　如果只是配置HDFS HA + Federation的话，仅需要用到上面3个文件即可。


　　需要注意的是:
　　　　(1)ns1和ns2的大部分配置信息均相同，唯一不同的就是journalnode的存放路径不同;
　　　　(2)我们应该按照业务逻辑划分出存储目录并将对应的配置信息写入mountTable.xml文件中(该文件名称自定义，但需要在core-site.xml中指明),如果您想要创建的根目录没有在mountTable.xml中定义的话，是无法创建的哟~

 

三.Apache HDFS Federation部署实战案例

1>.操作环境

[root@hadoop101.yinzhengjie.org.cn ~]# cat /etc/redhat-release 
CentOS Linux release 7.6.1810 (Core) 
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# uname -r
3.10.0-957.el7.x86_64
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# uname -m
x86_64
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# free -h
              total        used        free      shared  buff/cache   available
Mem:           3.8G        1.0G        2.5G         11M        347M        2.6G
Swap:            0B          0B          0B
[root@hadoop101.yinzhengjie.org.cn ~]# 

2>.配置所有的NameNode节点到集群的其它节点免密登录

　　由于我之前配置了hadoop101.yinzhengjie.org.cn和hadoop106.yinzhengjie.org.cn这两个namenode与集群的其它节点互通，因此我下面就只配置剩下的2个namnode节点与集群中其它节点免密登录即可。

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
Generating public/private rsa key pair.
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:b8owMyjygvLKvOLk0LyI7LG4B7oGVrCw8UZq9zbcvx0 root@hadoop102.yinzhengjie.org.cn
The key's randomart image is:
+---[RSA 2048]----+
|                 |
|o..              |
|.*o              |
|oooo             |
|..o o . S        |
|o+   * . .       |
|B++ o * . oE     |
|/=+o   * +. .    |
|&^=     o...     |
+----[SHA256]-----+
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ll ~/.ssh/
total 12
-rw------- 1 root root  830 Mar 12 07:28 authorized_keys
-rw------- 1 root root 1675 May 21 11:13 id_rsa
-rw-r--r-- 1 root root  415 May 21 11:13 id_rsa.pub
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop101.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop101.yinzhengjie.org.cn (172.200.4.101)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop101.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop101.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ssh root@hadoop101.yinzhengjie.org.cn
Last login: Wed May 20 21:18:10 2020 from 172.200.0.1
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 21:15 (172.200.0.1)
root     pts/1        2020-05-20 21:18 (172.200.0.1)
root     pts/2        2020-05-21 11:14 (172.200.4.102)
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop101.yinzhengjie.org.cn closed.
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop102.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop102.yinzhengjie.org.cn (172.200.4.102)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop102.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop102.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ssh root@hadoop102.yinzhengjie.org.cn
Last login: Wed May 20 22:25:54 2020 from 172.200.0.1
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
root     pts/1        2020-05-21 11:15 (172.200.4.102)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop102.yinzhengjie.org.cn closed.
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop103.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop103.yinzhengjie.org.cn (172.200.4.103)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop103.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop103.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ssh root@hadoop103.yinzhengjie.org.cn
Last login: Thu May 14 12:29:19 2020 from 172.200.0.1
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:15 (172.200.4.102)
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop103.yinzhengjie.org.cn closed.
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop104.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop104.yinzhengjie.org.cn (172.200.4.104)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop104.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop104.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ssh root@hadoop104.yinzhengjie.org.cn
Last login: Thu May 14 17:42:17 2020 from 172.200.0.1
[root@hadoop104.yinzhengjie.org.cn ~]# 
[root@hadoop104.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:16 (172.200.4.102)
[root@hadoop104.yinzhengjie.org.cn ~]# 
[root@hadoop104.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop105.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop105.yinzhengjie.org.cn (172.200.4.105)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop105.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop105.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ssh root@hadoop105.yinzhengjie.org.cn
Last login: Thu May 14 12:28:37 2020 from 172.200.0.1
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:17 (172.200.4.102)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop105.yinzhengjie.org.cn closed.
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop106.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop106.yinzhengjie.org.cn (172.200.4.106)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop106.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop106.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# ssh root@hadoop106.yinzhengjie.org.cn
Last login: Thu May 14 11:59:34 2020 from 172.200.4.101
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.4.102)
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop106.yinzhengjie.org.cn closed.
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
Generating public/private rsa key pair.
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:Qz9QfXpz6wDixPwNmpgUd7u9UBuyH2BOrBS4dBfueGI root@hadoop105.yinzhengjie.org.cn
The key's randomart image is:
+---[RSA 2048]----+
|        . .o.    |
|       + =.o. .  |
|      . X =..o   |
|       + OoX.oo .|
|      . SE%o@.oo.|
|       o.*oB * . |
|            o =  |
|             o . |
|                 |
+----[SHA256]-----+
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ll ~/.ssh/
total 12
-rw------- 1 root root 1245 May 21 11:17 authorized_keys
-rw------- 1 root root 1679 May 21 11:19 id_rsa
-rw-r--r-- 1 root root  415 May 21 11:19 id_rsa.pub
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop101.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop101.yinzhengjie.org.cn (172.200.4.101)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop101.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop101.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ssh root@hadoop101.yinzhengjie.org.cn
Last login: Thu May 21 11:14:17 2020 from 172.200.4.102
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 21:15 (172.200.0.1)
root     pts/1        2020-05-20 21:18 (172.200.0.1)
root     pts/2        2020-05-21 11:20 (172.200.4.105)
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop101.yinzhengjie.org.cn closed.
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop102.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop102.yinzhengjie.org.cn (172.200.4.102)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop102.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop102.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ssh root@hadoop102.yinzhengjie.org.cn
Last login: Thu May 21 11:15:08 2020 from 172.200.4.102
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-20 22:25 (172.200.0.1)
root     pts/1        2020-05-21 11:21 (172.200.4.105)
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop102.yinzhengjie.org.cn closed.
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop103.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop103.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop103.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who 
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ssh root@hadoop103.yinzhengjie.org.cn
Last login: Thu May 21 11:21:56 2020 from 172.200.4.105
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:22 (172.200.4.105)
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop103.yinzhengjie.org.cn closed.
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop104.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop104.yinzhengjie.org.cn (172.200.4.104)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop104.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop104.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ssh root@hadoop104.yinzhengjie.org.cn
Last login: Thu May 21 11:16:37 2020 from 172.200.4.102
[root@hadoop104.yinzhengjie.org.cn ~]# 
[root@hadoop104.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:23 (172.200.4.105)
[root@hadoop104.yinzhengjie.org.cn ~]# 
[root@hadoop104.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop104.yinzhengjie.org.cn closed.
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop105.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop105.yinzhengjie.org.cn (172.200.4.105)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop105.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop105.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ssh root@hadoop105.yinzhengjie.org.cn
Last login: Thu May 21 11:18:42 2020 from 172.200.0.1
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
root     pts/1        2020-05-21 11:23 (172.200.4.105)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop105.yinzhengjie.org.cn closed.
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# ssh-copy-id root@hadoop106.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hadoop106.yinzhengjie.org.cn (172.200.4.106)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a:93:c0:d4:6e:7e:13:16:61:f1:93:a7:38:01.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hadoop106.yinzhengjie.org.cn's password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@hadoop106.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# ssh root@hadoop106.yinzhengjie.org.cn
Last login: Thu May 21 11:18:14 2020 from 172.200.4.102
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:24 (172.200.4.105)
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# exit 
logout
Connection to hadoop106.yinzhengjie.org.cn closed.
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# who
root     pts/0        2020-05-21 11:18 (172.200.0.1)
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 

3>.启动journalnode集群

[root@hadoop101.yinzhengjie.org.cn ~]# ansible jn -m ping
hadoop104.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
hadoop102.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
hadoop103.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible jn -m shell -a 'jps'
hadoop104.yinzhengjie.org.cn | SUCCESS | rc=0 >>
4972 Jps

hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5244 Jps

hadoop103.yinzhengjie.org.cn | SUCCESS | rc=0 >>
4954 Jps

[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible jn -m shell -a 'hadoop-daemon.sh start journalnode'
hadoop103.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting journalnode, logging to /yinzhengjie/softwares/ha/logs/hadoop-root-journalnode-hadoop103.yinzhengjie.org.cn.out

hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting journalnode, logging to /yinzhengjie/softwares/ha/logs/hadoop-root-journalnode-hadoop102.yinzhengjie.org.cn.out

hadoop104.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting journalnode, logging to /yinzhengjie/softwares/ha/logs/hadoop-root-journalnode-hadoop104.yinzhengjie.org.cn.out

[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible jn -m shell -a 'jps'
hadoop103.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5033 JournalNode
5129 Jps

hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5321 JournalNode
5417 Jps

hadoop104.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5152 Jps
5049 JournalNode

[root@hadoop101.yinzhengjie.org.cn ~]# 

4>.在nn1节点格式化文件系统并启动namenode

[root@hadoop101.yinzhengjie.org.cn ~]# hdfs namenode -format
20/05/21 12:10:35 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = hadoop101.yinzhengjie.org.cn/172.200.4.101
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 12:10:35 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 12:10:35 INFO namenode.NameNode: createNameNode [-format]
Formatting using clusterid: CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
20/05/21 12:10:36 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 12:10:36 INFO namenode.FSNamesystem: KeyProvider: null
20/05/21 12:10:36 INFO namenode.FSNamesystem: fsLock is fair: true
20/05/21 12:10:36 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false
20/05/21 12:10:36 INFO namenode.FSNamesystem: fsOwner             = root (auth:SIMPLE)
20/05/21 12:10:36 INFO namenode.FSNamesystem: supergroup          = supergroup
20/05/21 12:10:36 INFO namenode.FSNamesystem: isPermissionEnabled = true
20/05/21 12:10:36 INFO namenode.FSNamesystem: Determined nameservice ID: ns1
20/05/21 12:10:36 INFO namenode.FSNamesystem: HA Enabled: true
20/05/21 12:10:36 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
20/05/21 12:10:36 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000
20/05/21 12:10:36 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
20/05/21 12:10:36 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
20/05/21 12:10:36 INFO blockmanagement.BlockManager: The block deletion will start around 2020 May 21 12:10:36
20/05/21 12:10:36 INFO util.GSet: Computing capacity for map BlocksMap
20/05/21 12:10:36 INFO util.GSet: VM type       = 64-bit
20/05/21 12:10:36 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB
20/05/21 12:10:36 INFO util.GSet: capacity      = 2^21 = 2097152 entries
20/05/21 12:10:36 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
20/05/21 12:10:36 WARN conf.Configuration: No unit for dfs.heartbeat.interval(3) assuming SECONDS
20/05/21 12:10:36 WARN conf.Configuration: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS
20/05/21 12:10:36 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
20/05/21 12:10:36 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0
20/05/21 12:10:36 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000
20/05/21 12:10:36 INFO blockmanagement.BlockManager: defaultReplication         = 3
20/05/21 12:10:36 INFO blockmanagement.BlockManager: maxReplication             = 512
20/05/21 12:10:36 INFO blockmanagement.BlockManager: minReplication             = 1
20/05/21 12:10:36 INFO blockmanagement.BlockManager: maxReplicationStreams      = 2
20/05/21 12:10:36 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
20/05/21 12:10:36 INFO blockmanagement.BlockManager: encryptDataTransfer        = false
20/05/21 12:10:36 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 1000
20/05/21 12:10:36 INFO namenode.FSNamesystem: Append Enabled: true
20/05/21 12:10:36 INFO namenode.FSDirectory: GLOBAL serial map: bits=24 maxEntries=16777215
20/05/21 12:10:36 INFO util.GSet: Computing capacity for map INodeMap
20/05/21 12:10:36 INFO util.GSet: VM type       = 64-bit
20/05/21 12:10:36 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB
20/05/21 12:10:36 INFO util.GSet: capacity      = 2^20 = 1048576 entries
20/05/21 12:10:36 INFO namenode.FSDirectory: ACLs enabled? false
20/05/21 12:10:36 INFO namenode.FSDirectory: XAttrs enabled? true
20/05/21 12:10:36 INFO namenode.NameNode: Caching file names occurring more than 10 times
20/05/21 12:10:36 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: falseskipCaptureAccessTimeOnlyChange: false
20/05/21 12:10:36 INFO util.GSet: Computing capacity for map cachedBlocks
20/05/21 12:10:36 INFO util.GSet: VM type       = 64-bit
20/05/21 12:10:36 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB
20/05/21 12:10:36 INFO util.GSet: capacity      = 2^18 = 262144 entries
20/05/21 12:10:36 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
20/05/21 12:10:36 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
20/05/21 12:10:36 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
20/05/21 12:10:36 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
20/05/21 12:10:36 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
20/05/21 12:10:36 INFO util.GSet: Computing capacity for map NameNodeRetryCache
20/05/21 12:10:36 INFO util.GSet: VM type       = 64-bit
20/05/21 12:10:36 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
20/05/21 12:10:36 INFO util.GSet: capacity      = 2^15 = 32768 entries
20/05/21 12:10:37 INFO namenode.FSImage: Allocated new BlockPoolId: BP-2134634205-172.200.4.101-1590034237309
20/05/21 12:10:37 INFO common.Storage: Storage directory /yinzhengjie/data/hdfs/federation/data/dfs/name has been successfully formatted.
20/05/21 12:10:37 INFO namenode.FSImageFormatProtobuf: Saving image file /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
20/05/21 12:10:37 INFO namenode.FSImageFormatProtobuf: Image file /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 323 bytes saved in 0 seconds .
20/05/21 12:10:37 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
20/05/21 12:10:37 INFO namenode.FSImage: FSImageSaver clean checkpoint: txid = 0 when meet shutdown.
20/05/21 12:10:37 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at hadoop101.yinzhengjie.org.cn/172.200.4.101
************************************************************/
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ll /yinzhengjie/data/hdfs/federation/
total 0
drwxr-xr-x 3 root root 17 May 21 12:10 data
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# find /yinzhengjie/data/hdfs/federation/
/yinzhengjie/data/hdfs/federation/
/yinzhengjie/data/hdfs/federation/data
/yinzhengjie/data/hdfs/federation/data/dfs
/yinzhengjie/data/hdfs/federation/data/dfs/name
/yinzhengjie/data/hdfs/federation/data/dfs/name/current
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/seen_txid
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000.md5
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION
#Thu May 21 12:10:37 CST 2020
namespaceID=516220939
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590034237309
storageType=NAME_NODE
blockpoolID=BP-2134634205-172.200.4.101-1590034237309
layoutVersion=-63
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# jps
5810 Jps
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# hadoop-daemon.sh start namenode
starting namenode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-namenode-hadoop101.yinzhengjie.org.cn.out
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# jps
5851 NameNode
5931 Jps
[root@hadoop101.yinzhengjie.org.cn ~]# 

5>.在nn2节点上同步nn1元数据信息并启动namenode

[root@hadoop102.yinzhengjie.org.cn ~]# hdfs namenode -bootstrapStandby
20/05/21 12:17:01 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = hadoop102.yinzhengjie.org.cn/172.200.4.102
STARTUP_MSG:   args = [-bootstrapStandby]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 12:17:01 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 12:17:01 INFO namenode.NameNode: createNameNode [-bootstrapStandby]
20/05/21 12:17:01 INFO ha.BootstrapStandby: Found nn: nn1, ipc: hadoop101.yinzhengjie.org.cn/172.200.4.101:9000
=====================================================
About to bootstrap Standby ID nn2 from:
           Nameservice ID: ns1
        Other Namenode ID: nn1
  Other NN's HTTP address: http://hadoop101.yinzhengjie.org.cn:50070
  Other NN's IPC  address: hadoop101.yinzhengjie.org.cn/172.200.4.101:9000
             Namespace ID: 516220939
            Block pool ID: BP-2134634205-172.200.4.101-1590034237309
               Cluster ID: CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
           Layout version: -63
       isUpgradeFinalized: true
=====================================================
20/05/21 12:17:02 INFO common.Storage: Storage directory /yinzhengjie/data/hdfs/federation/data/dfs/name has been successfully formatted.
20/05/21 12:17:02 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 12:17:02 INFO namenode.TransferFsImage: Opening connection to http://hadoop101.yinzhengjie.org.cn:50070/imagetransfer?getimage=1&txid=0&storageInfo=-63:516220939:1590034237309:CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636&bootstrapstandby=true
20/05/21 12:17:02 INFO common.Util: Combined time for fsimage download and fsync to all disks took 0.00s. The fsimage download took 0.00s at 0.00 KB/s. Synchronous (fsync) write to disk of /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage.ckpt_000000000000
0000000 took 0.00s.20/05/21 12:17:02 INFO namenode.TransferFsImage: Downloaded file fsimage.ckpt_0000000000000000000 size 323 bytes.
20/05/21 12:17:02 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at hadoop102.yinzhengjie.org.cn/172.200.4.102
************************************************************/
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# ll /yinzhengjie/data/hdfs/federation/
total 0
drwxr-xr-x 3 root root 17 May 21 12:17 data
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# find /yinzhengjie/data/hdfs/federation/
/yinzhengjie/data/hdfs/federation/
/yinzhengjie/data/hdfs/federation/data
/yinzhengjie/data/hdfs/federation/data/dfs
/yinzhengjie/data/hdfs/federation/data/dfs/name
/yinzhengjie/data/hdfs/federation/data/dfs/name/current
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/seen_txid
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000.md5
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION
#Thu May 21 12:17:02 CST 2020
namespaceID=516220939
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590034237309
storageType=NAME_NODE
blockpoolID=BP-2134634205-172.200.4.101-1590034237309
layoutVersion=-63
[root@hadoop102.yinzhengjie.org.cn ~]# 

[root@hadoop102.yinzhengjie.org.cn ~]# jps
4087 JournalNode
4415 Jps
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# hadoop-daemon.sh start namenode
starting namenode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-namenode-hadoop102.yinzhengjie.org.cn.out
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# jps
4087 JournalNode
4442 NameNode
4522 Jps
[root@hadoop102.yinzhengjie.org.cn ~]# 
[root@hadoop102.yinzhengjie.org.cn ~]# 

6>.在nn1节点上执行编辑日志初始化

[root@hadoop101.yinzhengjie.org.cn ~]# hdfs namenode -initializeSharedEdits
20/05/21 12:38:47 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = hadoop101.yinzhengjie.org.cn/172.200.4.101
STARTUP_MSG:   args = [-initializeSharedEdits]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 12:38:47 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 12:38:47 INFO namenode.NameNode: createNameNode [-initializeSharedEdits]
20/05/21 12:38:47 WARN namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!
20/05/21 12:38:47 WARN namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directories!
20/05/21 12:38:47 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 12:38:47 INFO namenode.FSNamesystem: KeyProvider: null
20/05/21 12:38:47 INFO namenode.FSNamesystem: fsLock is fair: true
20/05/21 12:38:47 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false
20/05/21 12:38:47 INFO namenode.FSNamesystem: fsOwner             = root (auth:SIMPLE)
20/05/21 12:38:47 INFO namenode.FSNamesystem: supergroup          = supergroup
20/05/21 12:38:47 INFO namenode.FSNamesystem: isPermissionEnabled = true
20/05/21 12:38:47 INFO namenode.FSNamesystem: Determined nameservice ID: ns1
20/05/21 12:38:47 INFO namenode.FSNamesystem: HA Enabled: true
20/05/21 12:38:47 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
20/05/21 12:38:47 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000
20/05/21 12:38:47 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
20/05/21 12:38:47 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
20/05/21 12:38:47 INFO blockmanagement.BlockManager: The block deletion will start around 2020 May 21 12:38:47
20/05/21 12:38:47 INFO util.GSet: Computing capacity for map BlocksMap
20/05/21 12:38:47 INFO util.GSet: VM type       = 64-bit
20/05/21 12:38:47 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB
20/05/21 12:38:47 INFO util.GSet: capacity      = 2^21 = 2097152 entries
20/05/21 12:38:47 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
20/05/21 12:38:47 WARN conf.Configuration: No unit for dfs.heartbeat.interval(3) assuming SECONDS
20/05/21 12:38:47 WARN conf.Configuration: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS
20/05/21 12:38:47 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
20/05/21 12:38:47 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0
20/05/21 12:38:47 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000
20/05/21 12:38:47 INFO blockmanagement.BlockManager: defaultReplication         = 3
20/05/21 12:38:47 INFO blockmanagement.BlockManager: maxReplication             = 512
20/05/21 12:38:47 INFO blockmanagement.BlockManager: minReplication             = 1
20/05/21 12:38:47 INFO blockmanagement.BlockManager: maxReplicationStreams      = 2
20/05/21 12:38:47 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
20/05/21 12:38:47 INFO blockmanagement.BlockManager: encryptDataTransfer        = false
20/05/21 12:38:47 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 1000
20/05/21 12:38:47 INFO namenode.FSNamesystem: Append Enabled: true
20/05/21 12:38:47 INFO namenode.FSDirectory: GLOBAL serial map: bits=24 maxEntries=16777215
20/05/21 12:38:47 INFO util.GSet: Computing capacity for map INodeMap
20/05/21 12:38:47 INFO util.GSet: VM type       = 64-bit
20/05/21 12:38:47 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB
20/05/21 12:38:47 INFO util.GSet: capacity      = 2^20 = 1048576 entries
20/05/21 12:38:47 INFO namenode.FSDirectory: ACLs enabled? false
20/05/21 12:38:47 INFO namenode.FSDirectory: XAttrs enabled? true
20/05/21 12:38:47 INFO namenode.NameNode: Caching file names occurring more than 10 times
20/05/21 12:38:47 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: falseskipCaptureAccessTimeOnlyChange: false
20/05/21 12:38:47 INFO util.GSet: Computing capacity for map cachedBlocks
20/05/21 12:38:47 INFO util.GSet: VM type       = 64-bit
20/05/21 12:38:47 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB
20/05/21 12:38:47 INFO util.GSet: capacity      = 2^18 = 262144 entries
20/05/21 12:38:47 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
20/05/21 12:38:47 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
20/05/21 12:38:47 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
20/05/21 12:38:47 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
20/05/21 12:38:47 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
20/05/21 12:38:47 INFO util.GSet: Computing capacity for map NameNodeRetryCache
20/05/21 12:38:47 INFO util.GSet: VM type       = 64-bit
20/05/21 12:38:47 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
20/05/21 12:38:47 INFO util.GSet: capacity      = 2^15 = 32768 entries
20/05/21 12:38:47 INFO common.Storage: Lock on /yinzhengjie/data/hdfs/federation/data/dfs/name/in_use.lock acquired by nodename 6681@hadoop101.yinzhengjie.org.cn
20/05/21 12:38:47 INFO namenode.FSImage: No edit log streams selected.
20/05/21 12:38:47 INFO namenode.FSImage: Planning to load image: FSImageFile(file=/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000)
20/05/21 12:38:47 INFO namenode.FSImageFormatPBINode: Loading 1 INodes.
20/05/21 12:38:47 INFO namenode.FSImageFormatPBINode: Successfully loaded 1 inodes
20/05/21 12:38:47 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.
20/05/21 12:38:47 INFO namenode.FSImage: Loaded image for txid 0 from /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000
20/05/21 12:38:47 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=true, isRollingUpgrade=false)
20/05/21 12:38:47 INFO namenode.NameCache: initialized with 0 entries 0 lookups
20/05/21 12:38:47 INFO namenode.FSNamesystem: Finished loading FSImage in 74 msecs
20/05/21 12:38:47 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 12:38:48 INFO namenode.FileJournalManager: Recovering unfinalized segments in /yinzhengjie/data/hdfs/federation/data/dfs/name/current
20/05/21 12:38:48 INFO client.QuorumJournalManager: Starting recovery process for unclosed journal segments...
20/05/21 12:38:48 INFO client.QuorumJournalManager: Successfully started new epoch 1
20/05/21 12:38:48 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at hadoop101.yinzhengjie.org.cn/172.200.4.101
************************************************************/
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop103.yinzhengjie.org.cn ~]# ll /yinzhengjie/data/hdfs/federation
total 0
drwxr-xr-x 3 root root 17 May 21 12:38 edits
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# find /yinzhengjie/data/hdfs/federation
/yinzhengjie/data/hdfs/federation
/yinzhengjie/data/hdfs/federation/edits
/yinzhengjie/data/hdfs/federation/edits/ns1
/yinzhengjie/data/hdfs/federation/edits/ns1/in_use.lock
/yinzhengjie/data/hdfs/federation/edits/ns1/current
/yinzhengjie/data/hdfs/federation/edits/ns1/current/VERSION
/yinzhengjie/data/hdfs/federation/edits/ns1/current/paxos
/yinzhengjie/data/hdfs/federation/edits/ns1/current/last-promised-epoch
/yinzhengjie/data/hdfs/federation/edits/ns1/current/committed-txid
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# 

[root@hadoop103.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/edits/ns1/current/VERSION 
#Thu May 21 12:38:48 CST 2020
namespaceID=516220939
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590034237309
storageType=JOURNAL_NODE
layoutVersion=-63
[root@hadoop103.yinzhengjie.org.cn ~]# 
[root@hadoop103.yinzhengjie.org.cn ~]# 

7>.启动zookeeper集群

　　自行搭建zookeeper集群:
　　　　https://www.cnblogs.com/yinzhengjie2020/p/12501023.html

[root@hadoop101.yinzhengjie.org.cn ~]# zookeeper.sh start
启动服务
========== zookeeper101.yinzhengjie.org.cn zkServer.sh start ================
/yinzhengjie/softwares/jdk1.8.0_201/bin/java
ZooKeeper JMX enabled by default
Using config: /yinzhengjie/softwares/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
========== zookeeper102.yinzhengjie.org.cn zkServer.sh start ================
/yinzhengjie/softwares/jdk1.8.0_201/bin/java
ZooKeeper JMX enabled by default
Using config: /yinzhengjie/softwares/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
========== zookeeper103.yinzhengjie.org.cn zkServer.sh start ================
/yinzhengjie/softwares/jdk1.8.0_201/bin/java
ZooKeeper JMX enabled by default
Using config: /yinzhengjie/softwares/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# zookeeper.sh status
查看状态
========== zookeeper101.yinzhengjie.org.cn zkServer.sh status ================
/yinzhengjie/softwares/jdk1.8.0_201/bin/java
ZooKeeper JMX enabled by default
Using config: /yinzhengjie/softwares/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: follower
========== zookeeper102.yinzhengjie.org.cn zkServer.sh status ================
/yinzhengjie/softwares/jdk1.8.0_201/bin/java
ZooKeeper JMX enabled by default
Using config: /yinzhengjie/softwares/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: leader
========== zookeeper103.yinzhengjie.org.cn zkServer.sh status ================
/yinzhengjie/softwares/jdk1.8.0_201/bin/java
ZooKeeper JMX enabled by default
Using config: /yinzhengjie/softwares/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: follower
[root@hadoop101.yinzhengjie.org.cn ~]# 

8>.在nn1节点初始化ns1的hdfs ha 在zookeeper集群中的状态

[root@hadoop101.yinzhengjie.org.cn ~]# hdfs zkfc -formatZK
20/05/21 12:54:57 INFO tools.DFSZKFailoverController: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting DFSZKFailoverController
STARTUP_MSG:   host = hadoop101.yinzhengjie.org.cn/172.200.4.101
STARTUP_MSG:   args = [-formatZK]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 12:54:57 INFO tools.DFSZKFailoverController: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 12:54:57 INFO tools.DFSZKFailoverController: Failover controller configured for NameNode NameNode at hadoop101.yinzhengjie.org.cn/172.200.4.101:9000
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop101.yinzhengjie.org.cn
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_201
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.home=/yinzhengjie/softwares/jdk1.8.0_201/jre
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-
core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jar20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/yinzhengjie/softwares/federation/lib/native
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-957.el7.x86_64
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:user.name=root
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Client environment:user.dir=/root
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop101.yinzhengjie.org.cn:2181,hadoop102.yinzhengjie.org.cn:2181,hadoop103.yinzhengjie.org.cn:2181 sessionTimeout=10000 watcher=org.apache.hadoop.ha.ActiveStandbyElector$WatcherWi
thClientRef@67a20f6720/05/21 12:54:57 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop103.yinzhengjie.org.cn/172.200.4.103:2181. Will not attempt to authenticate using SASL (unknown error)
20/05/21 12:54:57 INFO zookeeper.ClientCnxn: Socket connection established to hadoop103.yinzhengjie.org.cn/172.200.4.103:2181, initiating session
20/05/21 12:54:57 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop103.yinzhengjie.org.cn/172.200.4.103:2181, sessionid = 0x67000026f1a90000, negotiated timeout = 10000
20/05/21 12:54:57 INFO ha.ActiveStandbyElector: Successfully created /hadoop-ha/ns1 in ZK.
20/05/21 12:54:57 INFO zookeeper.ZooKeeper: Session: 0x67000026f1a90000 closed
20/05/21 12:54:57 WARN ha.ActiveStandbyElector: Ignoring stale result from old client with sessionId 0x67000026f1a90000
20/05/21 12:54:57 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x67000026f1a90000
20/05/21 12:54:57 INFO tools.DFSZKFailoverController: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down DFSZKFailoverController at hadoop101.yinzhengjie.org.cn/172.200.4.101
************************************************************/
[root@hadoop101.yinzhengjie.org.cn ~]# 

9>.ns1名称空间启动容灾控制器并查看namenode的WebUI

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns1 -m ping
hadoop101.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
hadoop102.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns1 -m shell -a 'jps'
hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
4442 NameNode
5018 JournalNode
5244 QuorumPeerMain
5615 Jps

hadoop101.yinzhengjie.org.cn | SUCCESS | rc=0 >>
7555 Jps
5851 NameNode
7099 ZooKeeperMain
6893 QuorumPeerMain

[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns1 -m shell -a 'hadoop-daemon.sh start zkfc'
hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting zkfc, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-zkfc-hadoop102.yinzhengjie.org.cn.out

hadoop101.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting zkfc, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-zkfc-hadoop101.yinzhengjie.org.cn.out

[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns1 -m shell -a 'jps'
hadoop101.yinzhengjie.org.cn | SUCCESS | rc=0 >>
7780 Jps
5851 NameNode
7099 ZooKeeperMain
7660 DFSZKFailoverController
6893 QuorumPeerMain

hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5794 Jps
5683 DFSZKFailoverController
4442 NameNode
5018 JournalNode
5244 QuorumPeerMain

[root@hadoop101.yinzhengjie.org.cn ~]# 

10>.登录nn5节点格式化系统时指定nn1生成的集群ID(因为我们想让4个namenode处于同一个集群)并启动namenode服务

[root@hadoop101.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION 
#Thu May 21 13:16:29 CST 2020
namespaceID=516220939
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590034237309
storageType=NAME_NODE
blockpoolID=BP-2134634205-172.200.4.101-1590034237309
layoutVersion=-63
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# hdfs namenode -help
Usage: hdfs namenode [-backup] | 
    [-checkpoint] | 
    [-format [-clusterid cid ] [-force] [-nonInteractive] ] | 
    [-upgrade [-clusterid cid] [-renameReserved<k-v pairs>] ] | 
    [-upgradeOnly [-clusterid cid] [-renameReserved<k-v pairs>] ] | 
    [-rollback] | 
    [-rollingUpgrade <rollback|downgrade|started> ] | 
    [-finalize] | 
    [-importCheckpoint] | 
    [-initializeSharedEdits] | 
    [-bootstrapStandby [-force] [-nonInteractive] [-skipSharedEditsCheck] ] | 
    [-recover [ -force] ] | 
    [-metadataVersion ]

Generic options supported are:
-conf <configuration file>        specify an application configuration file
-D <property=value>               define a value for a given property
-fs <file:///|hdfs://namenode:port> specify default filesystem URL to use, overrides 'fs.defaultFS' property from configurations.
-jt <local|resourcemanager:port>  specify a ResourceManager
-files <file1,...>                specify a comma-separated list of files to be copied to the map reduce cluster
-libjars <jar1,...>               specify a comma-separated list of jar files to be included in the classpath
-archives <archive1,...>          specify a comma-separated list of archives to be unarchived on the compute machines

The general command line syntax is:
command [genericOptions] [commandOptions]

[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# hdfs namenode -format -clusterid CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
20/05/21 13:25:06 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = hadoop105.yinzhengjie.org.cn/172.200.4.105
STARTUP_MSG:   args = [-format, -clusterid, CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 13:25:06 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 13:25:06 INFO namenode.NameNode: createNameNode [-format, -clusterid, CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636]
Formatting using clusterid: CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
20/05/21 13:25:07 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 13:25:07 INFO namenode.FSNamesystem: KeyProvider: null
20/05/21 13:25:07 INFO namenode.FSNamesystem: fsLock is fair: true
20/05/21 13:25:07 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false
20/05/21 13:25:07 INFO namenode.FSNamesystem: fsOwner             = root (auth:SIMPLE)
20/05/21 13:25:07 INFO namenode.FSNamesystem: supergroup          = supergroup
20/05/21 13:25:07 INFO namenode.FSNamesystem: isPermissionEnabled = true
20/05/21 13:25:07 INFO namenode.FSNamesystem: Determined nameservice ID: ns2
20/05/21 13:25:07 INFO namenode.FSNamesystem: HA Enabled: true
20/05/21 13:25:07 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
20/05/21 13:25:07 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000
20/05/21 13:25:07 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
20/05/21 13:25:07 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
20/05/21 13:25:07 INFO blockmanagement.BlockManager: The block deletion will start around 2020 May 21 13:25:07
20/05/21 13:25:07 INFO util.GSet: Computing capacity for map BlocksMap
20/05/21 13:25:07 INFO util.GSet: VM type       = 64-bit
20/05/21 13:25:07 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB
20/05/21 13:25:07 INFO util.GSet: capacity      = 2^21 = 2097152 entries
20/05/21 13:25:07 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
20/05/21 13:25:07 WARN conf.Configuration: No unit for dfs.heartbeat.interval(3) assuming SECONDS
20/05/21 13:25:07 WARN conf.Configuration: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS
20/05/21 13:25:07 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
20/05/21 13:25:07 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0
20/05/21 13:25:07 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000
20/05/21 13:25:07 INFO blockmanagement.BlockManager: defaultReplication         = 3
20/05/21 13:25:07 INFO blockmanagement.BlockManager: maxReplication             = 512
20/05/21 13:25:07 INFO blockmanagement.BlockManager: minReplication             = 1
20/05/21 13:25:07 INFO blockmanagement.BlockManager: maxReplicationStreams      = 2
20/05/21 13:25:07 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
20/05/21 13:25:07 INFO blockmanagement.BlockManager: encryptDataTransfer        = false
20/05/21 13:25:07 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 1000
20/05/21 13:25:07 INFO namenode.FSNamesystem: Append Enabled: true
20/05/21 13:25:07 INFO namenode.FSDirectory: GLOBAL serial map: bits=24 maxEntries=16777215
20/05/21 13:25:07 INFO util.GSet: Computing capacity for map INodeMap
20/05/21 13:25:07 INFO util.GSet: VM type       = 64-bit
20/05/21 13:25:07 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB
20/05/21 13:25:07 INFO util.GSet: capacity      = 2^20 = 1048576 entries
20/05/21 13:25:07 INFO namenode.FSDirectory: ACLs enabled? false
20/05/21 13:25:07 INFO namenode.FSDirectory: XAttrs enabled? true
20/05/21 13:25:07 INFO namenode.NameNode: Caching file names occurring more than 10 times
20/05/21 13:25:07 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: falseskipCaptureAccessTimeOnlyChange: false
20/05/21 13:25:07 INFO util.GSet: Computing capacity for map cachedBlocks
20/05/21 13:25:07 INFO util.GSet: VM type       = 64-bit
20/05/21 13:25:07 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB
20/05/21 13:25:07 INFO util.GSet: capacity      = 2^18 = 262144 entries
20/05/21 13:25:07 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
20/05/21 13:25:07 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
20/05/21 13:25:07 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
20/05/21 13:25:07 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
20/05/21 13:25:07 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
20/05/21 13:25:07 INFO util.GSet: Computing capacity for map NameNodeRetryCache
20/05/21 13:25:07 INFO util.GSet: VM type       = 64-bit
20/05/21 13:25:07 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
20/05/21 13:25:07 INFO util.GSet: capacity      = 2^15 = 32768 entries
Re-format filesystem in QJM to [172.200.4.103:8485, 172.200.4.104:8485, 172.200.4.102:8485] ? (Y or N) Y
20/05/21 13:26:29 INFO namenode.FSImage: Allocated new BlockPoolId: BP-272272187-172.200.4.105-1590038789918
20/05/21 13:26:29 INFO common.Storage: Storage directory /yinzhengjie/data/hdfs/federation/data/dfs/name has been successfully formatted.
20/05/21 13:26:29 INFO namenode.FSImageFormatProtobuf: Saving image file /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
20/05/21 13:26:30 INFO namenode.FSImageFormatProtobuf: Image file /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 323 bytes saved in 0 seconds .
20/05/21 13:26:30 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
20/05/21 13:26:30 INFO namenode.FSImage: FSImageSaver clean checkpoint: txid = 0 when meet shutdown.
20/05/21 13:26:30 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at hadoop105.yinzhengjie.org.cn/172.200.4.105
************************************************************/
[root@hadoop105.yinzhengjie.org.cn ~]# 

[root@hadoop105.yinzhengjie.org.cn ~]# jps
6166 Jps
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# hadoop-daemon.sh start namenode
starting namenode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-namenode-hadoop105.yinzhengjie.org.cn.out
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# jps
6193 NameNode
6273 Jps
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 

11>.查看Journalnode集群

[root@hadoop103.yinzhengjie.org.cn ~]# find /yinzhengjie/data/hdfs/federation/edits
/yinzhengjie/data/hdfs/federation/edits
/yinzhengjie/data/hdfs/federation/edits/ns1
/yinzhengjie/data/hdfs/federation/edits/ns1/in_use.lock
/yinzhengjie/data/hdfs/federation/edits/ns1/current
/yinzhengjie/data/hdfs/federation/edits/ns1/current/VERSION
/yinzhengjie/data/hdfs/federation/edits/ns1/current/paxos
/yinzhengjie/data/hdfs/federation/edits/ns1/current/last-promised-epoch
/yinzhengjie/data/hdfs/federation/edits/ns1/current/committed-txid
/yinzhengjie/data/hdfs/federation/edits/ns1/current/last-writer-epoch
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000001-0000000000000000002
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000003-0000000000000000004
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000005-0000000000000000006
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000007-0000000000000000008
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000009-0000000000000000010
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000011-0000000000000000012
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000013-0000000000000000014
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000015-0000000000000000016
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000017-0000000000000000018
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000019-0000000000000000020
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_0000000000000000021-0000000000000000022
/yinzhengjie/data/hdfs/federation/edits/ns1/current/edits_inprogress_0000000000000000023
/yinzhengjie/data/hdfs/federation/edits/ns2
/yinzhengjie/data/hdfs/federation/edits/ns2/in_use.lock
/yinzhengjie/data/hdfs/federation/edits/ns2/current
/yinzhengjie/data/hdfs/federation/edits/ns2/current/VERSION
/yinzhengjie/data/hdfs/federation/edits/ns2/current/paxos
/yinzhengjie/data/hdfs/federation/edits/ns2/current/committed-txid
[root@hadoop103.yinzhengjie.org.cn ~]# 

[root@hadoop103.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/edits/ns1/current/VERSION
#Thu May 21 12:38:48 CST 2020
namespaceID=516220939
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590034237309
storageType=JOURNAL_NODE
layoutVersion=-63
[root@hadoop103.yinzhengjie.org.cn ~]# 

[root@hadoop103.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/edits/ns2/current/VERSION
#Thu May 21 13:26:29 CST 2020
namespaceID=843880487
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590038789918
storageType=JOURNAL_NODE
layoutVersion=-63
[root@hadoop103.yinzhengjie.org.cn ~]# 

12>.在nn6节点上同步nn5元数据信息并启动namenode

[root@hadoop106.yinzhengjie.org.cn ~]# hdfs namenode -bootstrapStandby
20/05/21 13:39:42 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = hadoop106.yinzhengjie.org.cn/172.200.4.106
STARTUP_MSG:   args = [-bootstrapStandby]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 13:39:42 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 13:39:42 INFO namenode.NameNode: createNameNode [-bootstrapStandby]
20/05/21 13:39:42 INFO ha.BootstrapStandby: Found nn: nn5, ipc: hadoop105.yinzhengjie.org.cn/172.200.4.105:9000
=====================================================
About to bootstrap Standby ID nn6 from:
           Nameservice ID: ns2
        Other Namenode ID: nn5
  Other NN's HTTP address: http://hadoop105.yinzhengjie.org.cn:50070
  Other NN's IPC  address: hadoop105.yinzhengjie.org.cn/172.200.4.105:9000
             Namespace ID: 843880487
            Block pool ID: BP-272272187-172.200.4.105-1590038789918
               Cluster ID: CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
           Layout version: -63
       isUpgradeFinalized: true
=====================================================
20/05/21 13:39:43 INFO common.Storage: Storage directory /yinzhengjie/data/hdfs/federation/data/dfs/name has been successfully formatted.
20/05/21 13:39:43 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 13:39:43 INFO namenode.TransferFsImage: Opening connection to http://hadoop105.yinzhengjie.org.cn:50070/imagetransfer?getimage=1&txid=0&storageInfo=-63:843880487:1590038789918:CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636&bootstrapstandby=true
20/05/21 13:39:43 INFO common.Util: Combined time for fsimage download and fsync to all disks took 0.00s. The fsimage download took 0.00s at 0.00 KB/s. Synchronous (fsync) write to disk of /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage.ckpt_000000000000
0000000 took 0.00s.20/05/21 13:39:43 INFO namenode.TransferFsImage: Downloaded file fsimage.ckpt_0000000000000000000 size 323 bytes.
20/05/21 13:39:43 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at hadoop106.yinzhengjie.org.cn/172.200.4.106
************************************************************/
[root@hadoop106.yinzhengjie.org.cn ~]# 

[root@hadoop106.yinzhengjie.org.cn ~]# find /yinzhengjie/data/hdfs/federation/
/yinzhengjie/data/hdfs/federation/
/yinzhengjie/data/hdfs/federation/data
/yinzhengjie/data/hdfs/federation/data/dfs
/yinzhengjie/data/hdfs/federation/data/dfs/name
/yinzhengjie/data/hdfs/federation/data/dfs/name/current
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/seen_txid
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000.md5
/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# 

[root@hadoop106.yinzhengjie.org.cn ~]# cat /yinzhengjie/data/hdfs/federation/data/dfs/name/current/VERSION
#Thu May 21 13:39:43 CST 2020
namespaceID=843880487
clusterID=CID-585ad57a-e5ae-4b15-a7ea-72444a6e0636
cTime=1590038789918
storageType=NAME_NODE
blockpoolID=BP-272272187-172.200.4.105-1590038789918
layoutVersion=-63
[root@hadoop106.yinzhengjie.org.cn ~]# 

[root@hadoop106.yinzhengjie.org.cn ~]# jps
5603 Jps
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# hadoop-daemon.sh start namenode
starting namenode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-namenode-hadoop106.yinzhengjie.org.cn.out
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# jps
5629 NameNode
5709 Jps
[root@hadoop106.yinzhengjie.org.cn ~]# 
[root@hadoop106.yinzhengjie.org.cn ~]# 

13>.在nn5节点上执行编辑日志初始化

[root@hadoop105.yinzhengjie.org.cn ~]# hdfs namenode -initializeSharedEdits
20/05/21 13:53:40 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = hadoop105.yinzhengjie.org.cn/172.200.4.105
STARTUP_MSG:   args = [-initializeSharedEdits]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 13:53:40 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 13:53:40 INFO namenode.NameNode: createNameNode [-initializeSharedEdits]
20/05/21 13:53:41 WARN namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!
20/05/21 13:53:41 WARN namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directories!
20/05/21 13:53:41 INFO namenode.FSEditLog: Edit logging is async:true
20/05/21 13:53:41 INFO namenode.FSNamesystem: KeyProvider: null
20/05/21 13:53:41 INFO namenode.FSNamesystem: fsLock is fair: true
20/05/21 13:53:41 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false
20/05/21 13:53:41 INFO namenode.FSNamesystem: fsOwner             = root (auth:SIMPLE)
20/05/21 13:53:41 INFO namenode.FSNamesystem: supergroup          = supergroup
20/05/21 13:53:41 INFO namenode.FSNamesystem: isPermissionEnabled = true
20/05/21 13:53:41 INFO namenode.FSNamesystem: Determined nameservice ID: ns2
20/05/21 13:53:41 INFO namenode.FSNamesystem: HA Enabled: true
20/05/21 13:53:41 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
20/05/21 13:53:41 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000
20/05/21 13:53:41 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
20/05/21 13:53:41 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
20/05/21 13:53:41 INFO blockmanagement.BlockManager: The block deletion will start around 2020 May 21 13:53:41
20/05/21 13:53:41 INFO util.GSet: Computing capacity for map BlocksMap
20/05/21 13:53:41 INFO util.GSet: VM type       = 64-bit
20/05/21 13:53:41 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB
20/05/21 13:53:41 INFO util.GSet: capacity      = 2^21 = 2097152 entries
20/05/21 13:53:41 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
20/05/21 13:53:41 WARN conf.Configuration: No unit for dfs.heartbeat.interval(3) assuming SECONDS
20/05/21 13:53:41 WARN conf.Configuration: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS
20/05/21 13:53:41 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
20/05/21 13:53:41 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0
20/05/21 13:53:41 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000
20/05/21 13:53:41 INFO blockmanagement.BlockManager: defaultReplication         = 3
20/05/21 13:53:41 INFO blockmanagement.BlockManager: maxReplication             = 512
20/05/21 13:53:41 INFO blockmanagement.BlockManager: minReplication             = 1
20/05/21 13:53:41 INFO blockmanagement.BlockManager: maxReplicationStreams      = 2
20/05/21 13:53:41 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
20/05/21 13:53:41 INFO blockmanagement.BlockManager: encryptDataTransfer        = false
20/05/21 13:53:41 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 1000
20/05/21 13:53:41 INFO namenode.FSNamesystem: Append Enabled: true
20/05/21 13:53:41 INFO namenode.FSDirectory: GLOBAL serial map: bits=24 maxEntries=16777215
20/05/21 13:53:41 INFO util.GSet: Computing capacity for map INodeMap
20/05/21 13:53:41 INFO util.GSet: VM type       = 64-bit
20/05/21 13:53:41 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB
20/05/21 13:53:41 INFO util.GSet: capacity      = 2^20 = 1048576 entries
20/05/21 13:53:41 INFO namenode.FSDirectory: ACLs enabled? false
20/05/21 13:53:41 INFO namenode.FSDirectory: XAttrs enabled? true
20/05/21 13:53:41 INFO namenode.NameNode: Caching file names occurring more than 10 times
20/05/21 13:53:41 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: falseskipCaptureAccessTimeOnlyChange: false
20/05/21 13:53:41 INFO util.GSet: Computing capacity for map cachedBlocks
20/05/21 13:53:41 INFO util.GSet: VM type       = 64-bit
20/05/21 13:53:41 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB
20/05/21 13:53:41 INFO util.GSet: capacity      = 2^18 = 262144 entries
20/05/21 13:53:41 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
20/05/21 13:53:41 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
20/05/21 13:53:41 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
20/05/21 13:53:41 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
20/05/21 13:53:41 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
20/05/21 13:53:41 INFO util.GSet: Computing capacity for map NameNodeRetryCache
20/05/21 13:53:41 INFO util.GSet: VM type       = 64-bit
20/05/21 13:53:41 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
20/05/21 13:53:41 INFO util.GSet: capacity      = 2^15 = 32768 entries
20/05/21 13:53:41 INFO common.Storage: Lock on /yinzhengjie/data/hdfs/federation/data/dfs/name/in_use.lock acquired by nodename 6520@hadoop105.yinzhengjie.org.cn
20/05/21 13:53:41 INFO namenode.FSImage: No edit log streams selected.
20/05/21 13:53:41 INFO namenode.FSImage: Planning to load image: FSImageFile(file=/yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000)
20/05/21 13:53:41 INFO namenode.FSImageFormatPBINode: Loading 1 INodes.
20/05/21 13:53:41 INFO namenode.FSImageFormatPBINode: Successfully loaded 1 inodes
20/05/21 13:53:41 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.
20/05/21 13:53:41 INFO namenode.FSImage: Loaded image for txid 0 from /yinzhengjie/data/hdfs/federation/data/dfs/name/current/fsimage_0000000000000000000
20/05/21 13:53:41 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=true, isRollingUpgrade=false)
20/05/21 13:53:41 INFO namenode.NameCache: initialized with 0 entries 0 lookups
20/05/21 13:53:41 INFO namenode.FSNamesystem: Finished loading FSImage in 83 msecs
20/05/21 13:53:41 INFO namenode.FSEditLog: Edit logging is async:true
Re-format filesystem in QJM to [172.200.4.103:8485, 172.200.4.104:8485, 172.200.4.102:8485] ? (Y or N) N
Format aborted in QJM to [172.200.4.103:8485, 172.200.4.104:8485, 172.200.4.102:8485]
20/05/21 13:53:43 INFO util.ExitUtil: Exiting with status 1: ExitException
20/05/21 13:53:43 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at hadoop105.yinzhengjie.org.cn/172.200.4.105
************************************************************/
[root@hadoop105.yinzhengjie.org.cn ~]# 
[root@hadoop105.yinzhengjie.org.cn ~]# 

14>.在nn5节点初始化ns2的hdfs ha 在zookeeper集群中的状态

[root@hadoop105.yinzhengjie.org.cn ~]# hdfs zkfc -formatZK
20/05/21 13:59:15 INFO tools.DFSZKFailoverController: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting DFSZKFailoverController
STARTUP_MSG:   host = hadoop105.yinzhengjie.org.cn/172.200.4.105
STARTUP_MSG:   args = [-formatZK]
STARTUP_MSG:   version = 2.10.0
STARTUP_MSG:   classpath = /yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share
/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jarSTARTUP_MSG:   build = ssh://git.corp.linkedin.com:29418/hadoop/hadoop.git -r e2f1f118e465e787d8567dfa6e2f3b72a0eb9194; compiled by 'jhung' on 2019-10-22T19:10Z
STARTUP_MSG:   java = 1.8.0_201
************************************************************/
20/05/21 13:59:15 INFO tools.DFSZKFailoverController: registered UNIX signal handlers for [TERM, HUP, INT]
20/05/21 13:59:16 INFO tools.DFSZKFailoverController: Failover controller configured for NameNode NameNode at hadoop105.yinzhengjie.org.cn/172.200.4.105:9000
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop105.yinzhengjie.org.cn
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_201
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.home=/yinzhengjie/softwares/jdk1.8.0_201/jre
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/yinzhengjie/softwares/federation/etc/hadoop:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-auth-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-
core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/mockito-all-1.8.5.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/common/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/common/hadoop-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okio-1.6.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-io-2.5.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-util-1.9.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/xmlenc-0.52.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/fst-2.50.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-framework-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-recipes-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guava-11.0.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-json-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-lang-2.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/nimbus-jose-jwt-4.41.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-net-3.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/activation-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jettison-1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-cli-1.2.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsch-0.1.54.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jersey-client-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/gson-2.2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-codec-1.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/zookeeper-3.4.9.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/jsp-api-2.1.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/commons-digester-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-client-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-api-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-registry-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/yarn/hadoop-yarn-server-router-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/asm-3.2.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/javax.inject-1.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/junit-4.11.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0-tests.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.0.jar:/yinzhengjie/softwares/federation/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.0.jar:/contrib/capacity-scheduler/*.jar20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/yinzhengjie/softwares/federation/lib/native
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-957.el7.x86_64
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:user.name=root
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Client environment:user.dir=/root
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop101.yinzhengjie.org.cn:2181,hadoop102.yinzhengjie.org.cn:2181,hadoop103.yinzhengjie.org.cn:2181 sessionTimeout=10000 watcher=org.apache.hadoop.ha.ActiveStandbyElector$WatcherWi
thClientRef@67a20f6720/05/21 13:59:16 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop103.yinzhengjie.org.cn/172.200.4.103:2181. Will not attempt to authenticate using SASL (unknown error)
20/05/21 13:59:16 INFO zookeeper.ClientCnxn: Socket connection established to hadoop103.yinzhengjie.org.cn/172.200.4.103:2181, initiating session
20/05/21 13:59:16 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop103.yinzhengjie.org.cn/172.200.4.103:2181, sessionid = 0x67000026f1a90001, negotiated timeout = 10000
20/05/21 13:59:16 INFO ha.ActiveStandbyElector: Successfully created /hadoop-ha/ns2 in ZK.
20/05/21 13:59:16 INFO zookeeper.ZooKeeper: Session: 0x67000026f1a90001 closed
20/05/21 13:59:16 WARN ha.ActiveStandbyElector: Ignoring stale result from old client with sessionId 0x67000026f1a90001
20/05/21 13:59:16 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x67000026f1a90001
20/05/21 13:59:16 INFO tools.DFSZKFailoverController: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down DFSZKFailoverController at hadoop105.yinzhengjie.org.cn/172.200.4.105
************************************************************/
[root@hadoop105.yinzhengjie.org.cn ~]# 

15>.ns2名称空间启动容灾控制器并查看namenode的WebUI

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns2 -m ping
hadoop106.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
hadoop105.yinzhengjie.org.cn | SUCCESS => {
    "changed": false, 
    "ping": "pong"
}
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns2 -m shell -a 'jps'
hadoop105.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6193 NameNode
6828 Jps

hadoop106.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6016 Jps
5629 NameNode

[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns2 -m shell -a 'hadoop-daemon.sh start zkfc'
hadoop106.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting zkfc, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-zkfc-hadoop106.yinzhengjie.org.cn.out

hadoop105.yinzhengjie.org.cn | SUCCESS | rc=0 >>
starting zkfc, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-zkfc-hadoop105.yinzhengjie.org.cn.out

[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible ns2 -m shell -a 'jps'
hadoop105.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6193 NameNode
7017 Jps
6906 DFSZKFailoverController

hadoop106.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6188 Jps
5629 NameNode
6095 DFSZKFailoverController

[root@hadoop101.yinzhengjie.org.cn ~]# 

16>.启动所有的datanode节点

[root@hadoop101.yinzhengjie.org.cn ~]# cat /yinzhengjie/softwares/federation/etc/hadoop/slaves 
hadoop101.yinzhengjie.org.cn
hadoop102.yinzhengjie.org.cn
hadoop103.yinzhengjie.org.cn
hadoop104.yinzhengjie.org.cn
hadoop105.yinzhengjie.org.cn
hadoop106.yinzhengjie.org.cn
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# hadoop-daemons.sh start datanode
hadoop105.yinzhengjie.org.cn: starting datanode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-datanode-hadoop105.yinzhengjie.org.cn.out
hadoop103.yinzhengjie.org.cn: starting datanode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-datanode-hadoop103.yinzhengjie.org.cn.out
hadoop106.yinzhengjie.org.cn: starting datanode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-datanode-hadoop106.yinzhengjie.org.cn.out
hadoop101.yinzhengjie.org.cn: starting datanode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-datanode-hadoop101.yinzhengjie.org.cn.out
hadoop104.yinzhengjie.org.cn: starting datanode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-datanode-hadoop104.yinzhengjie.org.cn.out
hadoop102.yinzhengjie.org.cn: starting datanode, logging to /yinzhengjie/softwares/federation/logs/hadoop-root-datanode-hadoop102.yinzhengjie.org.cn.out
[root@hadoop101.yinzhengjie.org.cn ~]# 

[root@hadoop101.yinzhengjie.org.cn ~]# ansible all -m shell -a 'jps'
hadoop106.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6432 Jps
5629 NameNode
6285 DataNode
6095 DFSZKFailoverController

hadoop103.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5216 Jps
4788 QuorumPeerMain
5077 DataNode
4573 JournalNode

hadoop104.yinzhengjie.org.cn | SUCCESS | rc=0 >>
4801 DataNode
4586 JournalNode
4940 Jps

hadoop101.yinzhengjie.org.cn | SUCCESS | rc=0 >>
8736 DataNode
8938 Jps
5851 NameNode
7099 ZooKeeperMain
7660 DFSZKFailoverController
6893 QuorumPeerMain

hadoop102.yinzhengjie.org.cn | SUCCESS | rc=0 >>
5683 DFSZKFailoverController
6291 Jps
6152 DataNode
4442 NameNode
5018 JournalNode
5244 QuorumPeerMain

hadoop105.yinzhengjie.org.cn | SUCCESS | rc=0 >>
6193 NameNode
6906 DFSZKFailoverController
7082 DataNode
7228 Jps

[root@hadoop101.yinzhengjie.org.cn ~]# 

17>.创建挂载目录，查看各个active目录的目录结构

[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -mkdir -p /home/yinzhengjie　　　　　　　　　　　　#需要注意的是，创建根下的目录必须在我们自定义的"mountTable.xml"文件中有对应的映射关系，否创是无法创建的哟~
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -mkdir -p /tmp/yinzhengjie
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -mkdir -p /projects/foo/yinzhengjie
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -mkdir -p /projects/bar/yinzhengjie
[root@hadoop101.yinzhengjie.org.cn ~]# 
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -ls -R / 
-r-xr-xr-x   - root root          0 2020-05-21 14:26 /home
dr-xr-xr-x   - root root          0 2020-05-21 14:26 /projects
-r-xr-xr-x   - root root          0 2020-05-21 14:26 /projects/bar
-r-xr-xr-x   - root root          0 2020-05-21 14:26 /projects/foo
-r-xr-xr-x   - root root          0 2020-05-21 14:26 /tmp
[root@hadoop101.yinzhengjie.org.cn ~]#