kafka问题汇总

1. 创建topic

/opt/cloudera/parcels/KAFKA-2.0.2-1.2.0.2.p0.5/lib/kafka/bin/kafka-topics.sh --create --zookeeper duan140:2181 --replication-factor 1 --partitions 1 --topic test

报错：

Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/ids

解决办法：

zookeeper查看节点：

连接：/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/zookeeper/bin/zkCli.sh -server duan140:2181

查看 : ls /

[hive_zookeeper_namespace_hive, zookeeper, hbase, kafka]

因为在安装过程中设置

ZooKeeper Root（zookeeper.chroot）为/kafka，该为默认即可。

 

2. 发送消息

/opt/cloudera/parcels/KAFKA-2.0.2-1.2.0.2.p0.5/lib/kafka/bin/kafka-console-producer.sh --broker-list duan140:9092 --topic test

报错：

clients.NetworkClient: Bootstrap broker duan140:9092 disconnected

 解决办法：

在/opt/cloudera/parcels/KAFKA-2.0.2-1.2.0.2.p0.5/lib/kafka/bin/kafka-run-class.sh 中添加如下红色字体：

  exec $JAVA -Djava.security.krb5.conf=/etc/krb5.conf -Djava.security.auth.login.config=/opt/cm-5.12.2/run/cloudera-scm-agent/process/12-kafka-KAFKA_BROKER/jaas.conf $KAFKA_HEAP_OPTS $KAFKA_JVM_PERFORMANCE_OPTS $KAFKA_GC_LOG_OPTS $KAFKA_JMX_OPTS $KAFKA_LOG4J_OPTS -cp $CLASSPATH $KAFKA_OPTS "$@"
不管用。