|NO.Z.00002|——————————|^^ 部署 ^^|——|Hadoop&OLAP_Kylin.V02|——|Kylin.v02|安装配置|
一、Kylin安装环境准备:依赖环境
软件 | 版本 |
Hive | 2.3.7 |
Hadoop | 2.9.2 |
HBase | 1.3.1 |
Zookeeper | 3.4.14 |
Kafka | 1.0.2 |
Spark | 2.4.5 |
二、集群规划
server | Hadoop01 | hadoop02 | hadoop03 | |
HDFS | NameNode | ✔ | ||
DataNode | ✔ | ✔ | ✔ | |
Yarn | ResourceManager | ✔ | ||
NodeManager | ✔ | ✔ | ✔ | |
JobHistoryServer | ✔ | |||
HBase | Hmaster | ✔ | ||
HRegionServer | ✔ | ✔ | ✔ | |
Hive | Hive | ✔ | ||
HiveMetastore | ✔ | |||
Zookeeper | ✔ | ✔ | ✔ | |
Kafka | ✔ | ✔ | ✔ | |
Kylin | ✔ |
### --- HBase配置文件参数
~~~ # 注意:要求hbase的hbase.zookeeper.quorum值必须只能是host1、host2、...
~~~ # 不允许出现host:2181;hbase-site.xml文件:
### --- 修改hbase配置文件
[root@hadoop01 ~]# vim /opt/yanqi/servers/hbase-1.3.1/conf/hbase-site.xml
<configuration>
<!-- 指定hbase在HDFS上存储的路径 -->
<property>
<name>hbase.rootdir</name>
<value>hdfs://hadoop01:9000/hbase</value>
</property>
<!-- 指定hbase是分布式的 -->
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<!-- 指定zk的地址,多个用“,”分割 -->
<property>
<name>hbase.zookeeper.quorum</name>
<value>hadoop01,hadoop02,hadoop03</value>
</property>
</configuration>
二、Kylin配置资源准备
### --- 下载kylin版本包并解压到安装目录
~~~ # 下载kylin版本包
[root@hadoop01 software]# wget https://archive.apache.org/dist/kylin/apache-kylin-3.1.1/apache-kylin-3.1.1-bin-hbase1x.tar.gz
~~~ # 解压版本包
[root@hadoop01 software]# tar -zxvf apache-kylin-3.1.1-bin-hbase1x.tar.gz -C ../servers/
~~~ # 修改配置目录名称
[root@hadoop01 ~]# cd /opt/yanqi/servers/
[root@hadoop01 servers]# mv apache-kylin-3.1.1-bin-hbase1x kylin-3.1.1
### --- 添加环境变量,并使之生效
~~~ # 配置kylin系统环境变量
[root@hadoop01 ~]# vim /etc/profile
##KYLIN_HOME
export KYLIN_HOME=/opt/yanqi/servers/kylin-3.1.1
export PATH=$PATH:$KYLIN_HOME/bin
~~~ # 使环境变量生效
[root@hadoop01 ~]# source /etc/profile
三、kylin安装部署
### --- 增加kylin依赖组件的配置
~~~ # 添加kylin依赖组件
[root@hadoop01 ~]# cd $KYLIN_HOME/conf
[root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml hdfs-site.xml
[root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/core-site.xml core-site.xml
[root@hadoop01 conf]# ln -s $HBASE_HOME/conf/hbase-site.xml hbase-site.xml
[root@hadoop01 conf]# ln -s $HIVE_HOME/conf/hive-site.xml hive-site.xml
[root@hadoop01 conf]# ln -s $SPARK_HOME/conf/spark-defaults.conf spark-defaults.conf
### --- 修改 kylin.sh
~~~ # 修改kylin.sh配置文件
[root@hadoop01 ~]# vim $KYLIN_HOME/bin/kylin.sh
~~~第21~24行添加如下内容:
export HADOOP_HOME=/opt/yanqi/servers/hadoop-2.9.2
export HIVE_HOME=/opt/yanqi/servers/hive-2.3.7
export HBASE_HOME=/opt/yanqi/servers/hbase-1.3.1
export SPARK_HOME=/opt/yanqi/servers/spark-2.4.5
### --- 检查依赖
[root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh
~~~输出参数
Retrieving hadoop conf dir...
...................................................[PASS]
KYLIN_HOME is set to /opt/yanqi/servers/kylin-3.1.1
Checking HBase
...................................................[PASS]
Checking hive
...................................................[PASS]
Checking hadoop shell
...................................................[PASS]
Checking hdfs working dir
...................................................[PASS]
Retrieving Spark dependency...
...................................................[PASS]
Retrieving Flink dependency...
Optional dependency flink not found, if you need this; set FLINK_HOME, or run bin/download-flink.sh
...................................................[PASS]
Retrieving kafka dependency...
...................................................[PASS]
Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.
四、启动集群
### --- 启动 zookeeper(Hadoop01)
~~~ # 启动zookeeper集群
[root@hadoop01 ~]# ./zk.sh start
### --- 启动 HDFS(Hadoop01)
~~~ # 启动hdfs服务:Hadoop01
[root@hadoop01 ~]# start-dfs.sh
### --- 启动 YARN (Hadoop01)
~~~ # 启动yarn服务:Hadoop01
[root@hadoop01 ~]# start-yarn.sh
### --- 启动 HBase(Hadoop01)
~~~ # 启动HBase服务:Hadoop01
[root@hadoop01 ~]# start-hbase.sh
### --- 启动 metastore(Hadoop01、Hadoop03)
~~~ # 启动hive-metastore服务:Hadoop01、Hadoop03
[root@hadoop01 ~]# nohup hive --service metastore &
~~~ # 查看metastore进程
[root@hadoop01 ~]# lsof -i:9083
### --- 启动Yarn history server(Hadoop01)
~~~ # 启动yarn history server:Hadoop01
[root@hadoop01 ~]# mr-jobhistory-daemon.sh start historyserver
### --- 启动 kylin(Hadoop01)
~~~ # 启动kylin服务:Hadoop01
[root@hadoop01 ~]# kylin.sh start
五、访问kylin-UI管理界面
### --- 访问kylin-UI管理界面
~~~ 登录 Kylin Web界面
~~~ 通过Chrome访问:http://hadoop01:7070/kylin:Kylin初始界面
~~~ Kylin管理界面
URL | http://hadoop01:7070/kylin |
默认用户名 | ADMIN |
默认密码 | KYLIN 备注:用户名和密码都必须是大写 |


附录一:报错处理一:
### --- 报错现象:
[root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh
/opt/yanqi/servers/kylin-3.1.1/bin/check-port-availability.sh: line 30: netstat: command not found
### --- 报错分析:
~~~ net-tools工具未安装
### --- 解决方案:
[root@hadoop01 ~]# yum -y install net-tools
Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart
——W.S.Landor
分类:
bdv023-kylin
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 无需6万激活码!GitHub神秘组织3小时极速复刻Manus,手把手教你使用OpenManus搭建本
· Manus爆火,是硬核还是营销?
· 终于写完轮子一部分:tcp代理 了,记录一下
· 别再用vector<bool>了!Google高级工程师:这可能是STL最大的设计失误
· 单元测试从入门到精通