大数据集群之Cloudera Manager部署CDH5.15.1的WebUI界面详解

一、安装CDH的服务

1、CM的WebUI界面默认的用户名/密码都是小写的admin,我们输入用户名和密码进行登录：操作如下：

2、同意CM的协议，点击继续

3、选择CM的免费版本

4、点击继续

5、为CDH集群安装指定主机

6、选择CDH本地版本（即我们已经下载的版本）

7、CDH的默认存放路径介绍

8、当CDH安装完毕后，点击继续

9、等待查检主机完成

10、根据下面的提示去相应的服务器做具体的操作,操作完成后点击“重新运行”以验证是否配置成功！

11解决告警信息，点击完成

[root@hexindai-c12-121 ~]# echo 10 > /proc/sys/vm/swappiness
[root@hexindai-c12-121 ~]# cat /proc/sys/vm/swappiness 
10
[root@hexindai-c12-121 ~]# 
[root@Hexindai-C12-122 ~]# echo 10 > /proc/sys/vm/swappiness
[root@Hexindai-C12-122 ~]# cat /proc/sys/vm/swappiness 
10
[root@Hexindai-C12-122 ~]# 
[root@Hexindai-C12-123 ~]# echo 10 > /proc/sys/vm/swappiness 
[root@Hexindai-C12-123 ~]# cat /proc/sys/vm/swappiness 
10
[root@Hexindai-C12-123 ~]#

[root@hexindai-c12-121 ~]# echo 10 > /proc/sys/vm/swappiness

[root@hexindai-c12-120 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/defrag
[root@hexindai-c12-120 init.d]# cat /sys/kernel/mm/transparent_hugepage/defrag
always madvise [never]
[root@hexindai-c12-120 init.d]#
[root@hexindai-c12-121 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/defrag
[root@hexindai-c12-121 init.d]# cat /sys/kernel/mm/transparent_hugepage/defrag
always madvise [never]
[root@hexindai-c12-121 init.d]#
[root@hexindai-c12-122 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/defrag
[root@hexindai-c12-122 init.d]# cat /sys/kernel/mm/transparent_hugepage/defrag
always madvise [never]
[root@hexindai-c12-122 init.d]#
[root@hexindai-c12-123 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/defrag
[root@hexindai-c12-123 init.d]# cat /sys/kernel/mm/transparent_hugepage/defrag
always madvise [never]
[root@hexindai-c12-123 init.d]#

[root@hexindai-c12-120 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/defrag

[root@hexindai-c12-120 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@hexindai-c12-120 init.d]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]
[root@hexindai-c12-120 init.d]#
[root@hexindai-c12-121 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@hexindai-c12-121 init.d]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]
[root@hexindai-c12-121 init.d]#
[root@hexindai-c12-122 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@hexindai-c12-122 init.d]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]
[root@hexindai-c12-122 init.d]#
[root@hexindai-c12-123 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@hexindai-c12-123 init.d]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]
[root@hexindai-c12-123 init.d]#

[root@hexindai-c12-120 init.d]# echo never > /sys/kernel/mm/transparent_hugepage/enabled

12、自定义需要安装的服务

13、分配角色

14、等待审核（也有可能会很快就跳到下一页，机器配置高的话）

15、集群设置

16、等待安装完成

17、完成安装后，点击继续

18、CDH部署成功界面

19、进入CDH主界面

二、验证CDH服务是否可用

1、验证zookeeper是否可以正常使用

[root@hexindai-c12-120 init.d]# zookeeper-client -server hexindai-c12-121
Connecting to hexindai-c12-121
2019-07-08 15:10:39,491 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.5-cdh5.15.1--1, built on 08/09/2018 16:19 GMT
2019-07-08 15:10:39,494 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=hexindai-c12-120
2019-07-08 15:10:39,494 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_211
2019-07-08 15:10:39,495 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2019-07-08 15:10:39,495 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/export/servers/jdk1.8.0_211/jre
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-957.21.3.el7.x86_64
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2019-07-08 15:10:39,496 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/opt/cloudera-manager/cm-5.15.1/etc/init.d
2019-07-08 15:10:39,497 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=hexindai-c12-121 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@306a30c7
Welcome to ZooKeeper!
2019-07-08 15:10:39,515 [myid:] - INFO  [main-SendThread(hexindai-c12-121:2181):ClientCnxn$SendThread@975] - Opening socket connection to server hexindai-c12-121/172.20.102.121:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2019-07-08 15:10:39,565 [myid:] - INFO  [main-SendThread(hexindai-c12-121:2181):ClientCnxn$SendThread@852] - Socket connection established, initiating session, client: /172.20.102.120:44214, server: hexindai-c12-121/172.20.102.121:2181
2019-07-08 15:10:39,572 [myid:] - INFO  [main-SendThread(hexindai-c12-121:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server hexindai-c12-121/172.20.102.121:2181, sessionid = 0x26bd0689aff0004, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: hexindai-c12-121(CONNECTED) 0]

登录zookeeper集群（[root@hexindai-c12-120 init.d]# zookeeper-client -server hexindai-c12-121 Connecting to hexindai-c12-121）

[zk: hexindai-c12-121(CONNECTED) 0] ls /
[zookeeper]
[zk: hexindai-c12-121(CONNECTED) 1] quit
Quitting...
2019-07-08 15:27:21,046 [myid:] - INFO  [main:ZooKeeper@684] - Session: 0x26bd0689aff0004 closed
2019-07-08 15:27:21,046 [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@512] - EventThread shut down
[root@hexindai-c12-120 init.d]#

2、查看hdfs目录信息（注意权限，如果想要往指定目录写数据的话，可以指定ACL）

[root@hexindai-c12-120 ~]# hdfs dfs -ls -R /
d-wx------   - hdfs supergroup          0 2019-07-08 14:37 /tmp
ls: Permission denied: user=root, access=READ_EXECUTE, inode="/tmp":hdfs:supergroup:d-wx------
drwxr-xr-x   - hdfs supergroup          0 2019-07-08 14:37 /user
drwxrwxrwx   - mapred hadoop              0 2019-07-08 14:37 /user/history
drwxrwx---   - mapred hadoop              0 2019-07-08 14:37 /user/history/done
ls: Permission denied: user=root, access=READ_EXECUTE, inode="/user/history/done":mapred:hadoop:drwxrwx---
drwxrwxrwt   - mapred hadoop              0 2019-07-08 14:37 /user/history/done_intermediate
[root@hexindai-c12-120 ~]#

3、查看hdfs的WebUI界面

查看hdfs的界面如下：

posted @ 2019-07-08 15:39 冠彭阅读(1284) 评论(0) 收藏举报

刷新页面返回顶部

wtnyihg

大数据集群之Cloudera Manager部署CDH5.15.1的WebUI界面详解