大数据集群之Cloudera Hadoop环境配置

　　　　　　　　　　　　　　　　　　　　大数据集群之Cloudera Hadoop环境配置

 一、安装Centos7.6最小化系统（系统盘和数据盘分离安装）

二、Centos7.6双网卡绑定实现高可用

三、大数据集群之系统调优

请参考该连接：https://www.cnblogs.com/wtnyihg/articles/11114524.html

四、ansbible自动化运维工具使用

 

五、NTP部署

    参考该连接：https://www.cnblogs.com/wtnyihg/articles/11115397.html

六、MySQL5.7主从复制

    参考该连接：https://www.cnblogs.com/wtnyihg/articles/11115885.html

 

七、安装MySQL Connector

    MySQL Connector是用来连接MySQL数据库的，根据我们的MySQL版本下载对应的连接器即可，我们在安装CM初始化的时候就会用到它。
    MySQL官方下载地址  https://dev.mysql.com/downloads/connector/j/

[root@hexindai-c12-120 software]# wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.47.tar.gz
--2019-07-04 09:54:08--  https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.47.tar.gz
Resolving dev.mysql.com (dev.mysql.com)... 137.254.60.11
Connecting to dev.mysql.com (dev.mysql.com)|137.254.60.11|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.47.tar.gz [following]
--2019-07-04 09:54:09--  https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.47.tar.gz
Resolving cdn.mysql.com (cdn.mysql.com)... 104.127.195.16
Connecting to cdn.mysql.com (cdn.mysql.com)|104.127.195.16|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4452049 (4.2M) [application/x-tar-gz]
Saving to: ‘mysql-connector-java-5.1.47.tar.gz’

100%[===========================================================================================================================================================>] 4,452,049   1.12MB/s   in 4.0s   

2019-07-04 09:54:13 (1.06 MB/s) - ‘mysql-connector-java-5.1.47.tar.gz’ saved [4452049/4452049]

[root@hexindai-c12-120 software]# 

[root@hexindai-c12-120 software]# ll
total 824540
-rw-r--r--. 1 root root      8409 Jul  1 14:27 jce_policy-8.zip
-rw-r--r--. 1 root root 194990602 Jul  1 14:55 jdk-8u211-linux-x64.tar.gz
-rw-r--r--. 1 root root 644869837 Jul  1 17:56 mysql-5.7.26-linux-glibc2.12-x86_64.tar.gz
-rw-r--r--. 1 root root   4452049 Aug  7  2018 mysql-connector-java-5.1.47.tar.gz
[root@hexindai-c12-120 software]# tar zxvf mysql-connector-java-5.1.47.tar.gz 
[root@hexindai-c12-120 software]# ll
total 824540
-rw-r--r--. 1 root root      8409 Jul  1 14:27 jce_policy-8.zip
-rw-r--r--. 1 root root 194990602 Jul  1 14:55 jdk-8u211-linux-x64.tar.gz
-rw-r--r--. 1 root root 644869837 Jul  1 17:56 mysql-5.7.26-linux-glibc2.12-x86_64.tar.gz
drwxr-xr-x. 3 root root       178 Aug  7  2018 mysql-connector-java-5.1.47
-rw-r--r--. 1 root root   4452049 Aug  7  2018 mysql-connector-java-5.1.47.tar.gz
[root@hexindai-c12-120 software]# ll mysql-connector-java-5.1.47
total 2448
-rw-r--r--. 1 root root   91845 Aug  7  2018 build.xml
-rw-r--r--. 1 root root  248527 Aug  7  2018 CHANGES
-rw-r--r--. 1 root root   18122 Aug  7  2018 COPYING
-rw-r--r--. 1 root root 1007505 Aug  7  2018 mysql-connector-java-5.1.47-bin.jar
-rw-r--r--. 1 root root 1007502 Aug  7  2018 mysql-connector-java-5.1.47.jar
-rw-r--r--. 1 root root   61407 Aug  7  2018 README
-rw-r--r--. 1 root root   63658 Aug  7  2018 README.txt
drwxr-xr-x. 8 root root      79 Aug  7  2018 src
[root@hexindai-c12-120 software]# 

 

[root@hexindai-c12-120 software]# ll mysql-connector-java-5.1.47
total 2448
-rw-r--r--. 1 root root   91845 Aug  7  2018 build.xml
-rw-r--r--. 1 root root  248527 Aug  7  2018 CHANGES
-rw-r--r--. 1 root root   18122 Aug  7  2018 COPYING
-rw-r--r--. 1 root root 1007505 Aug  7  2018 mysql-connector-java-5.1.47-bin.jar
-rw-r--r--. 1 root root 1007502 Aug  7  2018 mysql-connector-java-5.1.47.jar
-rw-r--r--. 1 root root   61407 Aug  7  2018 README
-rw-r--r--. 1 root root   63658 Aug  7  2018 README.txt
drwxr-xr-x. 8 root root      79 Aug  7  2018 src
[root@hexindai-c12-120 software]# mkdir /usr/share/java
[root@hexindai-c12-120 software]# cd /usr/share/java/
[root@hexindai-c12-120 java]# cp /export/software/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47*.jar .
[root@hexindai-c12-120 java]# ls
mysql-connector-java-5.1.47-bin.jar  mysql-connector-java-5.1.47.jar
[root@hexindai-c12-120 java]# rm mysql-connector-java-5.1.47.jar 
rm: remove regular file ‘mysql-connector-java-5.1.47.jar’? y
[root@hexindai-c12-120 java]# ls
mysql-connector-java-5.1.47-bin.jar
[root@hexindai-c12-120 java]# ln -s mysql-connector-java-5.1.47-bin.jar mysql-connector-java.jar            
[root@hexindai-c12-120 java]# ll
total 984
-rw-r--r--. 1 root root 1007505 Jul  4 15:52 mysql-connector-java-5.1.47-bin.jar
lrwxrwxrwx. 1 root root      35 Jul  4 15:52 mysql-connector-java.jar -> mysql-connector-java-5.1.47-bin.jar
[root@hexindai-c12-120 java]# 

八、Cloudera Manager安装：

Cloudera Manager基于二进制安装：
    https://www.cnblogs.com/wtnyihg/articles/11134287.html
Cloudera Manager基于Yum安装
    https://www.cnblogs.com/wtnyihg/articles/11151986.html