Zookeeper集群的正常部署,并启动[三个节点]
Hadoop集群的正常部署并启动[三个节点]
| start-dfs.sh |
| start-yarn.sh |
HBASE高可用搭建
hbase-env.sh
| export JAVA_HOME=/opt/app/jdk1.8.0_321 |
| |
| export HBASE_MANAGES_ZK=false |
hbase-site.xml
| <configuration> |
| <property> |
| <name>hbase.rootdir</name> |
| <value>hdfs://HadoopCluster/hbase</value> |
| </property> |
| |
| <property> |
| <name>hbase.cluster.distributed</name> |
| <value>true</value> |
| </property> |
| |
| |
| <property> |
| <name>hbase.master.port</name> |
| <value>16000</value> |
| </property> |
| |
| <property> |
| <name>hbase.zookeeper.quorum</name> |
| <value>node1:2181,node2:2181,node3:2181</value> |
| </property> |
| |
| <property> |
| <name>hbase.zookeeper.property.dataDir</name> |
| <value>/opt/app/zookeeper-3.4.6/zkData/</value> |
| </property> |
| </configuration> |
regionservers
hbase需要依赖的jar包
- 查询包命令
find /home/admin/modules/hadoop-2.7.2/ -name hadoop-annotations*
| |
| hadoop-annotations-2.7.2.jar |
| hadoop-auth-2.7.2.jar |
| hadoop-client-2.7.2.jar |
| hadoop-common-2.7.2.jar |
| hadoop-hdfs-2.7.2.jar |
| hadoop-mapreduce-client-app-2.7.2.jar |
| hadoop-mapreduce-client-common-2.7.2.jar |
| hadoop-mapreduce-client-core-2.7.2.jar |
| hadoop-mapreduce-client-hs-2.7.2.jar |
| hadoop-mapreduce-client-hs-plugins-2.7.2.jar |
| hadoop-mapreduce-client-jobclient-2.7.2.jar |
| hadoop-mapreduce-client-jobclient-2.7.2-tests.jar |
| hadoop-mapreduce-client-shuffle-2.7.2.jar |
| hadoop-yarn-api-2.7.2.jar |
| hadoop-yarn-applications-distributedshell-2.7.2.jar |
| hadoop-yarn-applications-unmanaged-am-launcher-2.7.2.jar |
| hadoop-yarn-client-2.7.2.jar |
| hadoop-yarn-common-2.7.2.jar |
| hadoop-yarn-server-applicationhistoryservice-2.7.2.jar |
| hadoop-yarn-server-common-2.7.2.jar |
| hadoop-yarn-server-nodemanager-2.7.2.jar |
| hadoop-yarn-server-resourcemanager-2.7.2.jar |
| hadoop-yarn-server-tests-2.7.2.jar |
| hadoop-yarn-server-web-proxy-2.7.2.jar |
| zookeeper-3.4.6.jar |
| |
| rm -rf /opt/app/hbase-1.6.0/lib/hadoop-* |
| rm -rf /opt/app/hbase-1.6.0/lib/zookeeper-3.4.6.jar |
| |
| |
| [root@node1 common] |
| /opt/app/hadoop-2.8.5/share/hadoop/common |
| [root@node1 common] |
| |
| |
| [root@node1 hdfs] |
| /opt/app/hadoop-2.8.5/share/hadoop/hdfs |
| [root@node1 hdfs] |
| |
| |
| [root@node1 mapreduce] |
| /opt/app/hadoop-2.8.5/share/hadoop/mapreduce |
| [root@node1 mapreduce] |
| |
| |
| [root@node1 yarn] |
| /opt/app/hadoop-2.8.5/share/hadoop/yarn |
| [root@node1 yarn] |
| cp |
| hadoop-yarn-api-2.8.5.jar |
| hadoop-yarn-applications-distributedshell-2.8.5.jar |
| hadoop-yarn-applications-unmanaged-am-launcher-2.8.5.jar |
| hadoop-yarn-client-2.8.5.jar |
| hadoop-yarn-common-2.8.5.jar |
| hadoop-yarn-server-applicationhistoryservice-2.8.5.jar |
| hadoop-yarn-server-common-2.8.5.jar |
| hadoop-yarn-server-nodemanager-2.8.5.jar |
| hadoop-yarn-server-resourcemanager-2.8.5.jar |
| hadoop-yarn-server-tests-2.8.5.jar |
| hadoop-yarn-server-web-proxy-2.8.5.jar /opt/app/hbase-1.6.0/lib/ |
| |
| |
| [root@node1 lib] |
| |
| |
| [root@node1 lib] |
| |
| |
| hadoop-client-2.8.5.jar没找到,手动导入的 |
| |
| |
| [root@node1 zookeeper-3.4.6] |
| /opt/app/zookeeper-3.4.6 |
| [root@node1 zookeeper-3.4.6] |
HBase软连接Hadoop配置
| ln -s /opt/app/hadoop-2.8.5/etc/hadoop/core-site.xml /opt/app/hbase-1.6.0/conf/core-site.xml |
| ln -s /opt/app/hadoop-2.8.5/etc/hadoop/hdfs-site.xml /opt/app/hbase-1.6.0/conf/hdfs-site.xml |
HBase服务启动/关闭
| 方式一: |
| # 启动 |
| [node1]# hbase-daemon.sh start master |
| [node1]# hbase-daemon.sh start regionserver |
| [node2]# hbase-daemon.sh start regionserver |
| [node3]# hbase-daemon.sh start regionserver |
| |
| # 关闭 |
| [node1]# hbase-daemon.sh stop master |
| [node1]# hbase-daemon.sh stop regionserver |
| [node2]# hbase-daemon.sh stop regionserver |
| [node3]# hbase-daemon.sh stop regionserver |
| 方式二:三台都会启动 |
| [node1]# start-hbase.sh |
| [node1]# stop-hbase.sh |
访问HBase页面
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· TypeScript + Deepseek 打造卜卦网站:技术与玄学的结合
· Manus的开源复刻OpenManus初探
· AI 智能体引爆开源社区「GitHub 热点速览」
· 三行代码完成国际化适配,妙~啊~
· .NET Core 中如何实现缓存的预热?