centos install kafka and zookeeper
1.安装zookeeper
ZooKeeper is a distributed, open-source coordination service for distributed applications.
1.下载
wget http://apache.fayea.com/zookeeper/zookeeper-3.3.6/zookeeper-3.3.6.tar.gz
2.解压复制
sudo mv zookeeper-3.3.6 /var/
3.编辑配置文件
在/var/zookeeper-3.3.6 下面的conf 里面有一个zoo_sample.cfg 复制一个zoo.cfg 然后编辑内容。我这里是都放在/var/data/下的 所以配置是这样的
# The number of milliseconds of each tick tickTime=2000 # The number of ticks that the initial # synchronization phase can take initLimit=10 # The number of ticks that can pass between # sending a request and getting an acknowledgement syncLimit=5 # the directory where the snapshot is stored. dataDir=/var/data/zookeeper # the port at which the clients will connect clientPort=2181
在此之前在先新建文件夹以及权限设置这种
4.启动
进入到bin目录 执行./zkServer.sh start
然后ps-ef|grep zoo能看到进程说明已经启动成功
5.测试
在bin目录下执行./zkCli.sh -server 127.0.0.1 然后下面会出现一堆日志信息
正常的是这样的
Connecting to 127.0.0.1:2181 2016-12-14 15:33:45,074 - INFO [main:Environment@97] - Client environment:zookeeper.version=3.3.6-1366786, built on 07/29/2012 06:22 GMT 2016-12-14 15:33:45,077 - INFO [main:Environment@97] - Client environment:host.name=iZ2322gd8vdZ 2016-12-14 15:33:45,077 - INFO [main:Environment@97] - Client environment:java.version=1.7.0_67 2016-12-14 15:33:45,078 - INFO [main:Environment@97] - Client environment:java.vendor=Oracle Corporation 2016-12-14 15:33:45,078 - INFO [main:Environment@97] - Client environment:java.home=/usr/java/jdk1.7.0_67/jre 2016-12-14 15:33:45,079 - INFO [main:Environment@97] - Client environment:java.class.path=/var/zookeeper-3.3.6/bin/../build/classes:/var/zookeeper-3.3.6/bin/../build/lib/*.jar:/var/zookeeper-3.3.6/bin/../zookeeper-3.3.6.jar:/var/zookeeper-3.3.6/bin/../lib/log4j-1.2.15.jar:/var/zookeeper-3.3.6/bin/../lib/jline-0.9.94.jar:/var/zookeeper-3.3.6/bin/../src/java/lib/*.jar:/var/zookeeper-3.3.6/bin/../conf:.:/usr/java/jdk1.7.0_67/lib:/usr/java/jdk1.7.0_67/jre/lib 2016-12-14 15:33:45,081 - INFO [main:Environment@97] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2016-12-14 15:33:45,081 - INFO [main:Environment@97] - Client environment:java.io.tmpdir=/tmp 2016-12-14 15:33:45,082 - INFO [main:Environment@97] - Client environment:java.compiler=<NA> 2016-12-14 15:33:45,082 - INFO [main:Environment@97] - Client environment:os.name=Linux 2016-12-14 15:33:45,083 - INFO [main:Environment@97] - Client environment:os.arch=amd64 2016-12-14 15:33:45,083 - INFO [main:Environment@97] - Client environment:os.version=2.6.32-431.23.3.el6.x86_64 2016-12-14 15:33:45,084 - INFO [main:Environment@97] - Client environment:user.name=root 2016-12-14 15:33:45,084 - INFO [main:Environment@97] - Client environment:user.home=/root 2016-12-14 15:33:45,084 - INFO [main:Environment@97] - Client environment:user.dir=/var/zookeeper-3.3.6/bin 2016-12-14 15:33:45,086 - INFO [main:ZooKeeper@379] - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@13a1d5cb Welcome to ZooKeeper! 2016-12-14 15:33:45,102 - INFO [main-SendThread():ClientCnxn$SendThread@1058] - Opening socket connection to server /127.0.0.1:2181 2016-12-14 15:33:45,110 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@947] - Socket connection established to localhost/127.0.0.1:2181, initiating session JLine support is enabled 2016-12-14 15:33:45,120 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@736] - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x158fc21940d0002, negotiated timeout = 30000
到这里zookeeper就安装结束了有什么不明白的可以去官网看看.这个是独立安装 也可以用kafka里面的那个
2.安装kafka
1.下载
wget http://apache.fayea.com/kafka/0.10.1.0/kafka_2.10-0.10.1.0.tgz
惯例解压然后复制
tar -xvf kafka_2.10-0.10.1.0
mv kafka_2.10-0.10.1.0 /var/
2.编辑配置文件
在kafka下面执行
vi bin/kafka-server-start.sh 默认
export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G" 我用的是这个 ,根据大家的配置自己配置就可以了
3.启动
bin/kafka-server-start.sh config/server.properties &
4.测试
1.新建topic
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
2.查看新建的topic
bin/kafka-topics.sh --list --zookeeper localhost:2181
3.使用刚才新建的topic 新建一个消息
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
然后就可以输入了
我随便输入的hello 1212121
4.再开一个终端 执行bin下面的
bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning
会看到输入的信息,至此全部完成。关于客户端的用法会在接下来的文章里出现
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】凌霞软件回馈社区,博客园 & 1Panel & Halo 联合会员上线
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 自定义通信协议——实现零拷贝文件传输
· Brainfly: 用 C# 类型系统构建 Brainfuck 编译器
· 智能桌面机器人:用.NET IoT库控制舵机并多方法播放表情
· Linux glibc自带哈希表的用例及性能测试
· 深入理解 Mybatis 分库分表执行原理
· DeepSeek 全面指南,95% 的人都不知道的9个技巧(建议收藏)
· 自定义Ollama安装路径
· 本地部署DeepSeek
· 快速入门 DeepSeek-R1 大模型
· DeepSeekV3+Roo Code,智能编码好助手