apache-kylin-2.5.2-bin-cdh57与cdh-5.13.0集群整合运用
1.下载kylin最新版apache-kylin-2.5.2-bin-cdh57;
2.解压配置环境变量;
export BASE_PATH="/opt/cloudera/parcels/CDH/lib" #added by hbase export HBASE_HOME="$BASE_PATH/hbase" export PATH="$HBASE_HOME/bin:$PATH" #added by HCat export HCAT_HOME="$BASE_PATH/hive-hcatalog" #added by kylin export KYLIN_HOME="/opt/kylin" export JAVA_HOME="/usr/java/jdk1.8.0_152" export PATH="$JAVA_HOME/bin:$PATH"
3.修改kylin中配置文件kylin.properties
## List of web servers in use, this enables one web server instance to sync up with other servers. kylin.server.cluster-servers=hadoopnode3:7070
添加:
#add by yourself kylin.job.jar=/opt/kylin/lib/kylin-job-2.5.2.jar kylin.coprocessor.local.jar=/opt/kylin/lib/kylin-coprocessor-2.5.2.jar kylin.job.yarn.app.rest.check.status.url=http://hadoopnode3:8088/ws/v1/cluster/apps/${job_id}?anonymous=true
4.kafka streaming cude 构建:
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic kylin_streaming_topic ##发送kafka消息 ./kylin.sh org.apache.kylin.source.kafka.util.KafkaSampleProducer --topic kylin_streaming_topic --broker hadoopnode2:9092