|NO.Z.00287|——————————|CloudNative|——|KuberNetes&运维.V09|——|EFLK架构.v04|部署kafka|
一、部署kafka:
### --- 组件helm+zookeeper+kafka
~~~ # 部署EFLK架构:
~~~ ElasticSearch+Filebeat+Logstash+Kibana+zookeeper+kafka
二、下载kafka版本包
### --- 添加bitnami的helm仓库
[root@k8s-master01 zookeeper-kafka]# helm repo add bitnami https://charts.bitnami.com/bitnami
### --- 查看添加的仓库
[root@k8s-master01 zookeeper-kafka]# helm repo list
NAME URL
bitnami https://charts.bitnami.com/bitnami
### --- 查看bitnami仓库下kafka的程序包
[root@k8s-master01 zookeeper-kafka]# helm search repo zookeeper
NAME CHART VERSION APP VERSION DESCRIPTION
bitnami/kafka 12.18.1 2.8.0 Apache Kafka is a distributed streaming platform.
### --- 下载bitnami仓库下kafka版本包
[root@k8s-master01 zookeeper-kafka]# helm pull bitnami/kafka
[root@k8s-master01 zookeeper-kafka]# tar -zxf kafka-12.18.1.tgz
三、配置kafka版本包配置文件
### --- 配置kafka的values配置文件
[root@k8s-master01 kafka]# vim values.yaml
~~~ # 注释一:
replicaCount: 1 # 副本数量设置为1
四、部署kafka
### --- 部署kafka
~~~ 在创建kafka的时候需要把kafka默认配置的zookeeper给关闭端,不然会启动一个新的zookeeper
[root@k8s-master01 kafka]# helm install kafka -n public-service --set zookeeper.enabled=false --set replicaCount=1 --set externalZookeeper.servers=zookeeper .
NAME: kafka
LAST DEPLOYED: Mon May 24 00:02:36 2021
NAMESPACE: public-service
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
** Please be patient while the chart is being deployed **
Kafka can be accessed by consumers via port 9092 on the following DNS name from within your cluster:
kafka.public-service.svc.cluster.local
Each Kafka broker can be accessed by producers via port 9092 on the following DNS name(s) from within your cluster:
kafka-0.kafka-headless.public-service.svc.cluster.local:9092
To create a pod that you can use as a Kafka client run the following commands:
kubectl run kafka-client --restart='Never' --image docker.io/bitnami/kafka:2.8.0-debian-10-r24 --namespace public-service --command -- sleep infinity
kubectl exec --tty -i kafka-client --namespace public-service -- bash
PRODUCER:
kafka-console-producer.sh \
--broker-list kafka-0.kafka-headless.public-service.svc.cluster.local:9092 \
--topic test
CONSUMER:
kafka-console-consumer.sh \
--bootstrap-server kafka.public-service.svc.cluster.local:9092 \
--topic test \
--from-beginning
五、查看创建的kafka
### --- 查看创建的kafka
[root@k8s-master01 kafka]# kubectl get po -n public-service -owide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
kafka-0 1/1 Running 0 76s 172.25.244.203 k8s-master01 <none> <none>
zookeeper-0 1/1 Running 0 11m 172.25.244.201 k8s-master01 <none> <none>
六、查看创建的kafka的service资源
### --- 查看创建的service
[root@k8s-master01 kafka]# kubectl get svc -n public-service -owide
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
kafka ClusterIP 10.98.0.73 <none> 9092/TCP 2m32s app.kubernetes.io/component=kafka,app.kubernetes.io/instance=kafka,app.kubernetes.io/name=kafka
kafka-headless ClusterIP None <none> 9092/TCP,9093/TCP 2m32s app.kubernetes.io/component=kafka,app.kubernetes.io/instance=kafka,app.kubernetes.io/name=kafka
kibana-logging NodePort 10.97.92.222 <none> 5601:30495/TCP 3h57m k8s-app=kibana-logging
Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart
——W.S.Landor
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 全程不用写代码,我用AI程序员写了一个飞机大战
· MongoDB 8.0这个新功能碉堡了,比商业数据库还牛
· 记一次.NET内存居高不下排查解决与启示
· DeepSeek 开源周回顾「GitHub 热点速览」
· 白话解读 Dapr 1.15:你的「微服务管家」又秀新绝活了