apache-kylin-2.5.2-bin-cdh57与cdh-5.13.0集群整合运用

1.下载kylin最新版apache-kylin-2.5.2-bin-cdh57;

2.解压配置环境变量;

export BASE_PATH="/opt/cloudera/parcels/CDH/lib"

#added by hbase
export HBASE_HOME="$BASE_PATH/hbase"
export PATH="$HBASE_HOME/bin:$PATH"

#added by HCat
export HCAT_HOME="$BASE_PATH/hive-hcatalog"

#added by kylin
export KYLIN_HOME="/opt/kylin"

export JAVA_HOME="/usr/java/jdk1.8.0_152"
export PATH="$JAVA_HOME/bin:$PATH"

3.修改kylin中配置文件kylin.properties

## List of web servers in use, this enables one web server instance to sync up with other servers.
kylin.server.cluster-servers=hadoopnode3:7070

添加:

#add by yourself
kylin.job.jar=/opt/kylin/lib/kylin-job-2.5.2.jar

kylin.coprocessor.local.jar=/opt/kylin/lib/kylin-coprocessor-2.5.2.jar

kylin.job.yarn.app.rest.check.status.url=http://hadoopnode3:8088/ws/v1/cluster/apps/${job_id}?anonymous=true

4.kafka streaming cude 构建:

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic kylin_streaming_topic
##发送kafka消息
./kylin.sh org.apache.kylin.source.kafka.util.KafkaSampleProducer --topic kylin_streaming_topic --broker hadoopnode2:9092

 

posted @ 2019-01-02 16:38  gongxiucheng  阅读(600)  评论(0编辑  收藏  举报