Ambari2.7.6安装
1. 安装配置Ambari Server
- 安装Ambari-server
cd apache-ambari-2.7.6-src/
yum install ambari-server/target/rpm/ambari-server/RPMS/x86_64/ambari-server*.rpm
ambari-server setup
/usr/sbin/ambari-server:行34: buildNumber: 为绑定变量
- 修改ambari-server文件
vi /usr/sbin/ambari-server
修改为
HASH="${VERSION}"
- 安装Ambari-server
再次执行ambari-server setup
Using python /usr/bin/python
Setup ambari-server
Checking SELinux...
SELinux status is 'enabled'
SELinux mode is 'enforcing'
Temporarily disabling SELinux
WARNING: SELinux is set to 'permissive' mode and temporarily disabled.
OK to continue [y/n] (y)? y
Customize user account for ambari-server daemon [y/n] (n)? n
Adjusting ambari-server permissions and ownership...
Checking firewall status...
WARNING: iptables is running. Confirm the necessary Ambari ports are accessible. Refer to the Ambari documentation for more details on ports.
OK to continue [y/n] (y)? y
Checking JDK...
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Custom JDK
==============================================================================
Enter choice (1): 2
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /usr/local/jdk_1.8
Validating JDK on Ambari Server...done.
Check JDK version for Ambari Server...
JDK version found: 8
Minimum JDK version is 8 for Ambari. Skipping to setup different JDK for Ambari Server.
Checking GPL software agreement...
GPL License for LZO: https://www.gnu.org/licenses/old-licenses/gpl-2.0.en.html
Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)? y
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? n
Configuring database...
Default properties detected. Using built-in database.
Configuring ambari database...
Checking PostgreSQL...
Running initdb: This may take up to a minute.
Initializing database ... OK
About to start PostgreSQL
Configuring local database...
Configuring PostgreSQL...
Restarting PostgreSQL
Creating schema and user...
done.
Creating tables...
done.
Extracting system views...
ambari-admin-2.7.6.0.0.jar
Ambari repo file doesn't contain latest json url, skipping repoinfos modification
Adjusting ambari-server permissions and ownership...
Ambari Server 'setup' completed successfully.
- 启动Ambari-server
ambari-server start
成功后在浏览器输入Ambari地址 http://ip:<prot_number>
port_number默认8080。用户名
admin,密码admin
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start............................
Server started listening on 8080
DB configs consistency check: no errors and warnings were found.
Ambari Server 'start' completed successfully.
如果浏览器未成功请求到Ambari页面，查看下8080端口信息及防火墙是否关闭。
lsof -i:8080
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
java 31253 root 210u IPv6 75454065 0t0 TCP *:webcache (LISTEN)
systemctl status firewalld
systemctl stop firewalld
systemctl disable firewalld
2. 安装Ambari-agent
- 安装ambari-agent
yum install ambari-agent/target/rpm/ambari-agent/RPMS/x86_64/ambari-agent-*.rpm
ambari-agent setup
/var/lib/ambari-agent/bin/ambari-agent:行23: buildNumber: 为绑定变量
修改配置
vi /var/lib/ambari-agent/bin/ambari-agent
# 将HASH="${buildNumber}"修改为: HASH="${VERSION}"
登录用户名密码均为admin，点击登录后，会提示初始化一个集群信息。
点击 Launch后，填写集群名称后，进入选择HDP版本及确定HDP/HDP-GPL/HDP-Utils所在的目录。
关于离线的HDP/HDP-GPL/HDP-Util制作，参照附录内容
填写目标主机Host地址，及私钥内容。
- 设置目标主机host
- 检查hostname
vi /etc/hostname
centos.novalocal
- 检查hosts
vi /etc/hosts
192.168.2.181 centos.novalocal
- 检查ambari-agent-ini
vi /etc/ambari-agent/conf/ambari-agent.ini
force_https_protocol=PROTOCOL_TLSv1_2
# 修改hostname一行为ambari-server对应的主机名
# 在security下面添加如下行:force_https_protocol=PROTOCOL_TLSv1_2,确保有下图所示的两个配置
启动ambari-agent
ambari-agent start
生成私钥。
ssh-keygen -t rsa 并三次回车
将私钥分发给各个节点，此处伪分布，因此只需要给本机分发。
ssh-copy-id centos.novalocal
拷贝私钥内容
cat ~/.ssh/id_rsa
-----BEGIN RSA PRIVATE KEY-----
MIIEpgIBAAKCAQEA3xiLT5S1r/F8vr21BY9x9XeHPHVQYVUi7pvN0k9kleoFAKDh
Neo19060dXL3zK68EiX/EKR4hzvEwhaR3QP1fR1h8H++dB/+6TdvEzdyeErQKTRY
MzUjQTNVUZM54LfyqS6eTAVxHegV992oXNA7cA4P/U02rmUN3Y02ghDEbUOlxwqf
VRKVk/x6/Dxc5896c4zvXnaYuWp1gaZ9UChDxS58/+xwcyWBe8KkOR6UfxH14fMw
J5OI4Tw8OEBPOjouhYbnzAw3o0dBnp5DtcGXZXjt99XZoN4DtRT3G+Tzvp1Iu0tX
qdL4y4E6prSNIN0o1jfkv2z5k7HjZ64diHYRAwIDAQABAoIBAQDXtlu9bwTeQplj
tPq7jZ+awSA6DRTTiAZmwK+akrmnWsfLe8NG5leX8Ln8dlWzy6B9y898wArqd5gg
MsKG+bT8bNSuPlZg4i8QQVFdO1eriGsN7Fb77H1SJdhxL/Henv47J6BX0Us2p5nW
OLT6ST2vc2lyep5MsdleR5RU3vGO0vOCfr3J/r4i1JkDyEeRBqIQsbpEIXq9l7S0
sTVCHL8AGj+ZqyQpRCqzZJoz7e/NLshqpJ3p999V36gscID5mQGapaeVBF28IVCN
PEiH8HngVIkdNNZVaVlnrWSJj/iRs9vkbNFF92DiP+SJVho/f85ZoCAYWd3aYILP
+JssGOdBAoGBAPkjhCVwBJZLebGIyZcYc0+5yLyqpDaB1v4266hYLrqndyI/mK09
TWHhwgULxEsxubnYm2qN6XLRRpNh+EIaL+2nHm4vU29Kla555t1Aq3yHENRX5tCm
o1+R2mZFD7lphuPNlIVczWDNsK+3Cx9p8WPT8idqEaaXH0GHRyFAp38vAoGBAOU9
a4VVLw8lRZ+g4kKfDNfcsCXx7JEVZ6HGGbaK/IlrcFF1uTibpfK2SNUdnNlFdupD
ZmkC+BluwXjTmKIj6Qx29R52HeXqnlNyv2RfM8RADJlHQh0BmV+VpLeYFU7hboGH
pbvkd321nEmdPMHRk3M0DNGQM7VIybcsRhqsfzZtAoGBAI0P6fuUkFRUycOWsqWl
h2zFwX3plG70Vzm6+PVpcJPozBCNN7InOpBIViWrQupcbk9m8KCFV3/WNIKwfvNW
hnqmHBnBHBmwfk264de2jSJGC2ZfmuXa5DfxilpLkhqmQGTtesGECRldfUQQfPC9
eJrQX5SnfvT3LhBZOxH93JirAoGBAJxnXXao+eSRf4E72WOu9KpKrfwVpVwPiJc9
e8mp5kc0AHvzoB3ZRE3mxKZy/9LVrB6FQdgf6HohsOrpI1hsu9J/TxoraJa3jrJM
tfybX8xkDrR9g8QalTQ7+xgwMUmSUT0a+Z7KcCRaxnkLSKrMfJe7SYupoT3snYPW
NzZ3vou5AoGBAO2RtiBK57HzIrxt5Oah6OfK/JBBEAgLF6jaHmBSN4U9hmzohuKD
6C+Orw9DWcLFyyGFW7NavBqqDwS6rLc0ReUNKqWkFMcTM/zzA4DWkprYnGTqN6UK
44XHsewjVgb8h/rhUKD4VhlXXO6MIBQTsYsDTD0q2e5sYGAuzndsqaZW
-----END RSA PRIVATE KEY-----
随后，下一步Ambari执行确认Host等信息。
点击下一步后，会看到选择安装服务。可以看到SmartSense为默认必选项
需要移除掉默认的SmartSense服务。
# 查找SMARTSENSE
find / -name SMARTSENSE |xargs
# 删除
rm -rf /var/lib/ambari-server/resources/stacks/HDP/3.0/services/SMARTSENSE /var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SMARTSENSE
重启ambari-server
ambari-server restart
此处我们选择zookeeper和zeppelin进行安装，并且SmartSense服务已经消失。
进入配置hive用户名密码以及hive连接的mysql配置信息。
报错：mysql-connector-java.jar找不到
2022-04-20 11:13:09,518 - File['/var/lib/ambari-agent/tmp/mysql-connector-java.jar'] {'content': DownloadSource('http://centos.novalocal:8080/resources/mysql-connector-java.jar')}
2022-04-20 11:13:09,519 - Downloading the file from http://centos.novalocal:8080/resources/mysql-connector-java.jar
在主机centos.novalocal中安装mysql-connector-java.jar
sudo yum install mysql-connector-java*
ls -al /usr/share/java/mysql-connector-java.jar
cd /var/lib/ambari-server/resources/
ln -s /usr/share/java/mysql-connector-java.jar mysql-connector-java.jar
点击重试（RETRY）。继续执行
随后next进入Ambari DashBoard主页面。
附录
离线安装HDP/HDP-Utils
HDP-Utils、HDP及GPL文件下载地址。
HDP 3.1.5 安装包及Ambari安装包下载：
链接: https://pan.baidu.com/s/1KsU1U5ltJYHuK7F893coAQ
提取码: ku5u
mkdir -p /var/www/html/ambari
解压上述三个文件
tar -zxvf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/ambari
tar -zxvf HDP-2.6.3.0-centos7-rpm.tar.gz -C /var/www/html/ambari
tar -zxvf HDP-GPL-3.1.5.0-centos7-gpl.tar.gz -C /var/www/html/ambari
tar -zxvf ambari-2.7.5.0-centos7.tar.gz -C /var/www/html/ambari
制作本地源
yum install yum-utils createrepo yum-plugin-priorities -y
createrepo ./
修改文件里面的源地址
vi HDP/centos7/2.6.3.0-235/hdp.repo
#VERSION_NUMBER=3.1.5.0-152
[HDP-3.1.5.0]
name=HDP Version - HDP-3.1.5.0
baseurl=http://192.168.2.157/ambari/HDP/centos7/3.1.5.0-152/
gpgcheck=0
[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://192.168.2.157/ambari/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/
gpgcheck=0
将ip修改为对应自己机器的ip
- 执行yum缓存
yum clean all
yum makecache
yum repolist
查看的时候可能rpm信息并不会出现，删除当前目录下index.html即可打开依赖目录。
在部署Ambari-server时，在select version中无法选择HDP版本。
此时需要将HDP-2.6.3.0-centos7-rpm.tar.gz解压后的HDP文件拷贝到 apache-ambari-2.7.6-src/ambari-server/src/main/resources/stacks/HDP中，重新执行编译命令即可。
