|NO.Z.00017|——————————|Deployment|——|Hadoop&OLAP数据库管理系统.v17|——|Kylin.v08|Kylin部署配置|

一、Kylin安装环境准备:依赖环境
软件 版本
Hive 2.3.7
Hadoop 2.9.2
HBase 1.3.1
Zookeeper 3.4.14
Kafka 1.0.2
Spark 2.4.5
二、集群规划
server Hadoop01 hadoop02 hadoop03
HDFS NameNode    
DataNode
Yarn ResourceManager    
NodeManager
JobHistoryServer    
HBase Hmaster    
HRegionServer
Hive Hive    
HiveMetastore    
Zookeeper
Kafka
Kylin    
三、HBase配置文件参数
### --- 注意:要求hbase的hbase.zookeeper.quorum值必须只能是host1、host2、...
### --- 不允许出现host:2181;hbase-site.xml文件:

~~~     # 修改hbase配置文件
[root@hadoop01 ~]# vim /opt/yanqi/servers/hbase-1.3.1/conf/hbase-site.xml
<configuration>

        <!-- 指定hbase在HDFS上存储的路径 -->
        <property>
                <name>hbase.rootdir</name>
                <value>hdfs://hadoop01:9000/hbase</value>
        </property>

        <!-- 指定hbase是分布式的 -->
        <property>
                <name>hbase.cluster.distributed</name>
                <value>true</value>
        </property>

        <!-- 指定zk的地址,多个用“,”分割 -->
        <property>
                <name>hbase.zookeeper.quorum</name>
                <value>hadoop01,hadoop02,hadoop03</value>
        </property>

</configuration>
四、Kylin配置资源准备
### --- 下载kylin版本包并解压到安装目录

~~~     # 下载kylin版本包
[root@hadoop01 software]# wget https://archive.apache.org/dist/kylin/apache-kylin-3.1.1/apache-kylin-3.1.1-bin-hbase1x.tar.gz
~~~     # 解压版本包
[root@hadoop01 software]# tar -zxvf apache-kylin-3.1.1-bin-hbase1x.tar.gz -C ../servers/
~~~     # 修改配置目录名称
[root@hadoop01 ~]# cd /opt/yanqi/servers/
[root@hadoop01 servers]# mv apache-kylin-3.1.1-bin-hbase1x kylin-3.1.1
### --- 添加环境变量,并使之生效

~~~     # 配置kylin系统环境变量
[root@hadoop01 ~]# vim /etc/profile
##KYLIN_HOME
export KYLIN_HOME=/opt/yanqi/servers/kylin-3.1.1
export PATH=$PATH:$KYLIN_HOME/bin
~~~     # 使环境变量生效

[root@hadoop01 ~]# source /etc/profile
五、kylin安装部署
### --- 增加kylin依赖组件的配置

~~~     # 添加kylin依赖组件
[root@hadoop01 ~]# cd $KYLIN_HOME/conf

[root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml hdfs-site.xml
[root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/core-site.xml core-site.xml
[root@hadoop01 conf]# ln -s $HBASE_HOME/conf/hbase-site.xml hbase-site.xml
[root@hadoop01 conf]# ln -s $HIVE_HOME/conf/hive-site.xml hive-site.xml
[root@hadoop01 conf]# ln -s $SPARK_HOME/conf/spark-defaults.conf spark-defaults.conf
### --- 修改 kylin.sh

~~~     # 修改kylin.sh配置文件
[root@hadoop01 ~]# vim $KYLIN_HOME/bin/kylin.sh
~~~第21~24行添加如下内容:
export HADOOP_HOME=/opt/yanqi/servers/hadoop-2.9.2
export HIVE_HOME=/opt/yanqi/servers/hive-2.3.7
export HBASE_HOME=/opt/yanqi/servers/hbase-1.3.1
export SPARK_HOME=/opt/yanqi/servers/spark-2.4.5
### --- 检查依赖

[root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh
 ~~~输出参数
 Retrieving hadoop conf dir...
...................................................[PASS]
KYLIN_HOME is set to /opt/yanqi/servers/kylin-3.1.1
Checking HBase
...................................................[PASS]
Checking hive
...................................................[PASS]
Checking hadoop shell
...................................................[PASS]
Checking hdfs working dir
...................................................[PASS]
Retrieving Spark dependency...
...................................................[PASS]
Retrieving Flink dependency...
Optional dependency flink not found, if you need this; set FLINK_HOME, or run bin/download-flink.sh
...................................................[PASS]
Retrieving kafka dependency...
...................................................[PASS]

Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.
六、启动集群
### --- 启动 zookeeper(Hadoop01)

~~~     # 启动zookeeper集群
[root@hadoop01 ~]# ./zk.sh start
### --- 启动 HDFS(Hadoop01)

~~~     # 启动hdfs服务:Hadoop01
[root@hadoop01 ~]# start-dfs.sh
### --- 启动 YARN (Hadoop01)

~~~     # 启动yarn服务:Hadoop01
[root@hadoop01 ~]# start-yarn.sh
### --- 启动 HBase(Hadoop01)

~~~     # 启动HBase服务:Hadoop01
[root@hadoop01 ~]# start-hbase.sh
### --- 启动 metastore(Hadoop01、Hadoop03)

~~~     # 启动hive-metastore服务:Hadoop01、Hadoop03
[root@hadoop01 ~]# nohup hive --service metastore &
~~~     # 查看metastore进程
[root@hadoop01 ~]# lsof -i:9083
### --- 启动Yarn history server(Hadoop01)

~~~     # 启动yarn history server:Hadoop01
[root@hadoop01 ~]# mr-jobhistory-daemon.sh start historyserver
### --- 启动 kylin(Hadoop01)

~~~     # 启动kylin服务:Hadoop01
[root@hadoop01 ~]# kylin.sh start
七、访问kylin-UI管理界面:登录 Kylin Web界面
URL http://hadoop01:7070/kylin
默认用户名 ADMIN
默认密码 KYLIN                                                      备注:用户名和密码都必须是大写
八、通过Chrome访问:http://hadoop01:7070/kylin:Kylin初始界面
九、Kylin管理界面

附录一:报错处理一:
### --- 报错想象

[root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh
/opt/yanqi/servers/kylin-3.1.1/bin/check-port-availability.sh: line 30: netstat: command not found 
### --- 报错分析

net-tools工具未安装
### --- 解决方案

[root@hadoop01 ~]#  yum -y install net-tools

 
 
 
 
 
 
 
 
 

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart
                                                                                                                                                   ——W.S.Landor

 

posted on   yanqi_vip  阅读(12)  评论(0编辑  收藏  举报

相关博文:
阅读排行:
· 全程不用写代码,我用AI程序员写了一个飞机大战
· MongoDB 8.0这个新功能碉堡了,比商业数据库还牛
· 记一次.NET内存居高不下排查解决与启示
· 白话解读 Dapr 1.15:你的「微服务管家」又秀新绝活了
· DeepSeek 开源周回顾「GitHub 热点速览」
< 2025年3月 >
23 24 25 26 27 28 1
2 3 4 5 6 7 8
9 10 11 12 13 14 15
16 17 18 19 20 21 22
23 24 25 26 27 28 29
30 31 1 2 3 4 5

导航

统计

点击右上角即可分享
微信分享提示