CDH搭建示例

准备工作

1.ntp时间同步

ntp管理节点

#默认的一个内部时钟数据,用在没有外部NTP服务器时,使用它为局域网用户提供服务
server 127.127.1.0
fudge 127.127.1.0 stratum 10

restrict 127.0.0.1
restrict ::1

# Hosts on local network are less restricted.
#restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst


server 127.127.1.0
fudge  127.127.1.0 stratum 10

#broadcast 192.168.1.255 autokey        # broadcast server
#broadcastclient                        # broadcast client
#broadcast 224.0.1.1 autokey            # multicast server
#multicastclient 224.0.1.1              # multicast client
#manycastserver 239.255.254.254         # manycast server
#manycastclient 239.255.254.254 autokey # manycast client

ntp服务端

#restrict 127.0.0.1
#restrict ::1

# Hosts on local network are less restricted.
#restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst


server 192.168.30.170

#broadcast 192.168.1.255 autokey        # broadcast server
#broadcastclient                        # broadcast client
#broadcast 224.0.1.1 autokey            # multicast server
#multicastclient 224.0.1.1              # multicast client
#manycastserver 239.255.254.254         # manycast server
#manycastclient 239.255.254.254 autokey # manycast client

ntp客户端etc/ntp.conf

2.主机名设置并同步hosts文件

192.168.30.170 hadoop-node1
192.168.30.75  hadoop-node2
192.168.30.76  hadoop-node3
192.168.30.79  hadoop-node4
192.168.30.98  hadoop-node5
192.168.30.99  hadoop-node6

View Code

3.防火墙关闭

4.任意两个节点之间实现ssh免密登录

主节点搭建

1.yum源搭建

[udap]
name=udap
baseurl=http://192.168.30.170/udap
gpgcheck=0
enabled=1

cdh.repo

yum clean all && yum makecache

2.安装包访问搭建

3.管理节点安装web管理系统

1.安装mysql

yum install mariadb* -y
systemctl start mariadb

mysql>create database UDAPf default character set utf8 collate utf8_general_ci;
mysql>grant all privileges on UDAPf.* to 'UDAPf'@'localhost' identified by 'UDAPf';
mysql>grant all privileges on UDAPf.* to 'UDAPf'@'%' identified by 'UDAPf';
mysql>flush privileges;

View Code

2.安装jdbc-mysql驱动

yum install mysql-connector-*

也可以把驱动jar包手动上传到/usr/share/java目录下

3.安装web管理系统

yum install cloudera-manager-server*

4.修改数据库配置文件信息

vi /etc/cloudera-scm-server/db.properties

com.cloudera.cmf.db.type=mysql
com.cloudera.cmf.db.host=localhost
com.cloudera.cmf.db.name=UDAPf
com.cloudera.cmf.db.user=UDAPf
com.cloudera.cmf.db.password=UDAPf
#com.cloudera.cmf.db.setupType=INIT 注意此项注释掉，否则CM启动报错

View Code

5.启动web系统

systemctl start cloudera-scm-server
chkconfig cloudera-scm-server on

6.访问web页面

admin/admin