10.4
HBase的安装与部署
11.1、Zookeeper集群的正常部署并启动
$ /opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6/bin/zkServer.sh start
11.2、Hadoop集群的正常部署并启动(我的为高可用HA)
$ /opt/modules/cdh/hadoop-2.5.0-cdh5.3.6/sbin/start-dfs.sh
$ /opt/modules/cdh/hadoop-2.5.0-cdh5.3.6/sbin/start-yarn.sh
11.3、上传(hbase-0.98.6-cdh5.3.6.tar.gz)并解压HBase
tar -zxvf hbase-0.98.6-cdh5.3.6.tar.gz -C /opt/module/
11.4进入配置文件目录( cd /opt/module/hbase-0.98.6-cdh5.3.6/conf/)
11.5删除cmd文件 ( rm -rf *.cmd )
11.6修改hbase-env.sh (vim hbase-env.sh )
11.7修改hbase-site.xml ( vim hbase-site.xml ),在<configuration>中添加
<configuration> <!--设置hbase节点位置 如果为高可用,则为高可用的名称例:hdfs://mycluster/hbase 如果是单节点,应该写成具体的哪台机器例:hdfs://hadoop201:80e --> <property> <name>hbase.rootdir</name> <value>hdfs://mycluster/hbase</value> </property> <!-- 是否运行在分布式上面 --> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <!-- 指定master节点 ,两种方式 1.只写端口号,表示可能用于高可用 例:60000 2.配置绝对的路径例:hadoop201:60000 --> <property> <name>hbase.master</name> <value>60000</value> </property> <!-- --> <property> <name>hbase.zookeeper.quorum</name> <value>hadoop201:2181,hadoop202:2181,hadoop203:2181</value> </property> <!-- 配置zookeeper的dataDir路径(会自动创建) --> <property> <name>hbase.zookeeper.property.dataDir</name> <value>/opt/module/zookeeper-3.4.5-cdh5.3.6/data/zkData</value> </property> </configuration>
11.8regionservers ( vim regionservers )
hadoop201 hadoop202 hadoop203
11.9替换HBase根目录下的lib目录下的与自己使用的版本不同的jar包为自己使用的jar包,以解决兼容问题
cd /opt/module/hbase-0.98.6-cdh5.3.6/lib/
rm -rf hadoop-*
如果zookeeper与使用的不同也需要删除替换,这里我的一样就不替换了()
涉及的jar包大约有
hadoop-annotations-2.5.0.jar hadoop-auth-2.5.0-cdh5.3.6.jar hadoop-client-2.5.0-cdh5.3.6.jar hadoop-common-2.5.0-cdh5.3.6.jar hadoop-hdfs-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-app-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-common-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-core-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-hs-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-hs-plugins-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.6.jar hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.6-tests.jar hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.6.jar hadoop-yarn-api-2.5.0-cdh5.3.6.jar hadoop-yarn-applications-distributedshell-2.5.0-cdh5.3.6.jar hadoop-yarn-applications-unmanaged-am-launcher-2.5.0-cdh5.3.6.jar hadoop-yarn-client-2.5.0-cdh5.3.6.jar hadoop-yarn-common-2.5.0-cdh5.3.6.jar hadoop-yarn-server-applicationhistoryservice-2.5.0-cdh5.3.6.jar hadoop-yarn-server-common-2.5.0-cdh5.3.6.jar hadoop-yarn-server-nodemanager-2.5.0-cdh5.3.6.jar hadoop-yarn-server-resourcemanager-2.5.0-cdh5.3.6.jar hadoop-yarn-server-tests-2.5.0-cdh5.3.6.jar hadoop-yarn-server-web-proxy-2.5.0-cdh5.3.6.jar zookeeper-3.4.5-cdh5.3.6.jar
可以通过find命令快速进行定位,例如
cd /opt/module/hadoop-2.5.0-cdh5.3.6/
find -name hadoop-hdfs-2.5.0-cdh5.3.6.jar
然后将找到的jar包复制到hbase的lib目录下
注:这里有我整理好的此版本的jar包放在(CDH_HadoopJar.tar.gz) (cp -a /opt/software/HadoopJar/* /opt/module/hbase-0.98.6-cdh5.3.6/lib/)
11.10将整理好的HBase安装目录scp到其他机器节点
cd /opt/module/ scp -r hbase-0.98.6-cdh5.3.6/ hadoop202:/opt/module/ scp -r hbase-0.98.6-cdh5.3.6/ hadoop203:/opt/module/
11.11将Hadoop配置文件软连接到HBase的conf目录下
* core-site.xml $ ln -s /opt/module/hadoop-2.5.0-cdh5.3.6/etc/hadoop/core-site.xml /opt/module/hbase-0.98.6-cdh5.3.6/conf/core-site.xml * hdfs-site.xml $ ln -s /opt/module/hadoop-2.5.0-cdh5.3.6/etc/hadoop/hdfs-site.xml /opt/module/hbase-0.98.6-cdh5.3.6/conf/hdfs-site.xml (尖叫提示:不要忘记其他几台机器也要做此操作)
11.12启动服务
$ bin/hbase-daemon.sh start master $ bin/hbase-daemon.sh start regionserver 或者: $ bin/start-hbase.sh 对应的停止命令: $ bin/stop-hbase.sh
11.13查看页面
启动成功后,可以通过主机名:60010地址来访问HBase的管理页面 例如,http://hadoop201:60010
参考文章:https://www.cnblogs.com/jokerq/p/10206287.html