Hbase 集群部署
1、部署说明
1.1、Java 版本
集群安装的jdk 版本是
[hui@hadoop201 ~]$ chkall.sh echo $JAVA_HOME
-----------hadoop201---------------
/opt/module/jdk1.8
-----------hadoop202---------------
/opt/module/jdk1.8
-----------hadoop203---------------
/opt/module/jdk1.8
官网关于jdk 与 hbase 版本的说明
官网地址
https://hbase.apache.org/book.html#java
1.2、Hadoop 版本
查看集群环境
[hui@hadoop201 ~]$ chkall.sh echo $HADOOP_HOME
-----------hadoop201---------------
/opt/module/hadoop-3.1.3
-----------hadoop202---------------
/opt/module/hadoop-3.1.3
-----------hadoop203---------------
/opt/module/hadoop-3.1.3
本次安装的hbase 版本是 hbase-2.0.5
1.3、zookeeper
hbase 本身依赖于 zk 进行协调服务，所以安装hbase 之前需要先将 zk 进行安装，可以参考
https://www.cnblogs.com/wdh01/p/13934436.html
2、Hbase 安装
2.1、解压安装
[hui@hadoop201 software]$ tar -axvf hbase-2.0.5-bin.tar.gz -C /opt/module/
[hui@hadoop201 module]$ mv hbase-2.0.5-bin hbase-2.0.5
2.2、配置
环境变量
[hui@hadoop201 hbase-2.0.5]$ sudo vim /etc/profile.d/my_env.sh #HBASE_HOME export HBASE_HOME=/opt/module/hbase-2.0.5 export PATH=$PATH:$HBASE_HOME/bin
hbase-env.sh
hui@hadoop201 conf]$ pwd /opt/module/hbase-2.0.5/conf [hui@hadoop201 conf]$ vim hbase-env.sh export JAVA_HOME=/opt/module/jdk1.8 export HBASE_CLASSPATH=/opt/module/hadoop-3.1.3/etc/hadoop/ #日志存放路径 export HBASE_LOG_DIR=/opt/module/hbase-2.0.5/logs #不使用hbase内置的xk管理hbase,使用自己安装的zk export HBASE_MANAGES_ZK=false
hbase-site.xml
<property> <name>hbase.rootdir</name> <value>hdfs://hadoop201:8020/hbase</value> <description> hdfs 存储路径</description> </property> <property> <name>hbase.cluster.distributed</name> <value>true</value> <description> 集群模式部署</description> </property> <property> <name>hbase.zookeeper.quorum</name> <value>hadoop201,hadoop202,hadoop203</value> <description> ZK 节点</description> </property> <property> <name>hbase.master.maxclockskew</name> <value>180000</value> <description> regionserver与master的时间差</description> </property>
regionservers 集群节点
[hui@hadoop103 conf]$ cat regionservers
hadoop201
hadoop202
hadoop203
2.3、分发
[hui@hadoop201 module]$ pwd
/opt/module
[hui@hadoop201 module]$ sxync.sh hbase-2.0.5/
[hui@hadoop201 ~]$ /home/hui/bin/sxync.sh /etc/profile.d/my_env.sh
环境变量生效
[hui@hadoop201 ~]$ chkall.sh source /etc/profile
2.4、启动
注意先启动zk 和 hdfs
[hui@hadoop201 ~]$ zk.sh start ---------- zookeeper hadoop201 启动 ------------ ZooKeeper JMX enabled by default Using config: /opt/module/zookeeper-3.5.7/bin/../conf/zoo.cfg Starting zookeeper ... STARTED ---------- zookeeper hadoop202 启动 ------------ ZooKeeper JMX enabled by default Using config: /opt/module/zookeeper-3.5.7/bin/../conf/zoo.cfg Starting zookeeper ... STARTED ---------- zookeeper hadoop203 启动 ------------ ZooKeeper JMX enabled by default Using config: /opt/module/zookeeper-3.5.7/bin/../conf/zoo.cfg Starting zookeeper ... STARTED [hui@hadoop201 ~]$ start-dfs.sh Starting namenodes on [hadoop201] Starting datanodes Starting secondary namenodes [hadoop203] [hui@hadoop201 ~]$ jps.sh -----------hadoop201--------------- 2145 NameNode 2581 Jps 1916 QuorumPeerMain 2301 DataNode -----------hadoop202--------------- 1994 DataNode 1869 QuorumPeerMain 2063 Jps -----------hadoop203--------------- 2132 SecondaryNameNode 2182 Jps 1864 QuorumPeerMain 1997 DataNode
最后启动 hbase
[hui@hadoop201 ~]$ cd /opt/module/hbase-2.0.5/ [hui@hadoop201 hbase-2.0.5]$ bin/start-hbase.sh running master, logging to /opt/module/hbase-2.0.5/logs/hbase-hui-master-hadoop201.out hadoop201: running regionserver, logging to /opt/module/hbase-2.0.5/logs/hbase-hui-regionserver-hadoop201.out hadoop202: running regionserver, logging to /opt/module/hbase-2.0.5/logs/hbase-hui-regionserver-hadoop202.out hadoop203: running regionserver, logging to /opt/module/hbase-2.0.5/logs/hbase-hui-regionserver-hadoop203.out hadoop202: running master, logging to /opt/module/hbase-2.0.5/logs/hbase-hui-master-hadoop202.out
2.5、master 高可用
默认情况下 hbase 有一个master,但是可以通过配置进行配置多个master 在conf 下 创建 backup-masters 文件，输入一个节点名称作为第二个master即可
hui@hadoop201 conf]$ less backup-masters
hadoop202
[hui@hadoop201 conf]$ pwd
/opt/module/hbase-2.0.5/conf
hui@hadoop201 conf]$ sxync.sh backup-masters
重启后高可用生效
