kafka使用技巧

新版本kafka(0.8以后):

查看topic:

kafka-topics --zookeeper zk1.ops.tc.yongche.org:2181/tkafka --list

查看指定topic中的数据:

zookeeper-client -server zk1.ops.tc.yongche.org:2181

kafka-console-consumer --bootstrap-server 10.2.2.41:9092 --topic sys.lbs.location.track

 

kafka-console-consumer --bootstrap-server 10.2.2.41:9092 --topic sys.lbs.location.track --from-beginning

 

kafa生产者写入数据

kafka-console-producer --broker-list kfk1.sys.bj2.yongche.com:9092,kfk2.sys.bj2.yongche.com:9092,kfk3.sys.bj2.yongche.com:9092,kfk4.sys.bj2.yongche.com:9092,kfk5.sys.bj2.yongche.com:9092 --topic sys.lbs.location.track < 111.log

 

 

10.0.11.192(老版本0.8以前):

生产者：

bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Hello-Kafka topic-name

消费者查看指定topic中的数据：

./bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sys.lbs.location.track | grep 50062398

./bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sys.lbs.location.track --from-beginning

查看所有topic:.

/bin/kafka-topics.sh --list --zookeeper localhost:2181

创建topic:

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic topic-name(一个分区和一个副本因子)

删除topic:

bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic topic_name

 

 

kafka配置文件路径server.properties：

opt/cloudera/parcels/KAFKA/etc/kafka/conf.dist