|NO.Z.00287|——————————|CloudNative|——|KuberNetes&运维.V09|——|EFLK架构.v04|部署kafka|

一、部署kafka:
### --- 组件helm+zookeeper+kafka

~~~     # 部署EFLK架构:
~~~     ElasticSearch+Filebeat+Logstash+Kibana+zookeeper+kafka
二、下载kafka版本包
### --- 添加bitnami的helm仓库

[root@k8s-master01 zookeeper-kafka]# helm repo add bitnami https://charts.bitnami.com/bitnami
### --- 查看添加的仓库

[root@k8s-master01 zookeeper-kafka]# helm repo list
NAME            URL                                                              
bitnami         https://charts.bitnami.com/bitnami 
### --- 查看bitnami仓库下kafka的程序包

[root@k8s-master01 zookeeper-kafka]# helm search repo zookeeper
NAME                        CHART VERSION   APP VERSION DESCRIPTION                                       
bitnami/kafka               12.18.1         2.8.0       Apache Kafka is a distributed streaming platform. 
### --- 下载bitnami仓库下kafka版本包

[root@k8s-master01 zookeeper-kafka]# helm pull bitnami/kafka
[root@k8s-master01 zookeeper-kafka]# tar -zxf kafka-12.18.1.tgz 
三、配置kafka版本包配置文件
### --- 配置kafka的values配置文件

[root@k8s-master01 kafka]# vim values.yaml 
~~~     # 注释一:
replicaCount: 1             # 副本数量设置为1
四、部署kafka
### --- 部署kafka
~~~     在创建kafka的时候需要把kafka默认配置的zookeeper给关闭端,不然会启动一个新的zookeeper

[root@k8s-master01 kafka]# helm install kafka -n public-service --set zookeeper.enabled=false --set replicaCount=1 --set externalZookeeper.servers=zookeeper .
NAME: kafka
LAST DEPLOYED: Mon May 24 00:02:36 2021
NAMESPACE: public-service
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
** Please be patient while the chart is being deployed **

Kafka can be accessed by consumers via port 9092 on the following DNS name from within your cluster:

    kafka.public-service.svc.cluster.local

Each Kafka broker can be accessed by producers via port 9092 on the following DNS name(s) from within your cluster:

    kafka-0.kafka-headless.public-service.svc.cluster.local:9092

To create a pod that you can use as a Kafka client run the following commands:

    kubectl run kafka-client --restart='Never' --image docker.io/bitnami/kafka:2.8.0-debian-10-r24 --namespace public-service --command -- sleep infinity
    kubectl exec --tty -i kafka-client --namespace public-service -- bash

    PRODUCER:
        kafka-console-producer.sh \
            
            --broker-list kafka-0.kafka-headless.public-service.svc.cluster.local:9092 \
            --topic test

    CONSUMER:
        kafka-console-consumer.sh \
            
            --bootstrap-server kafka.public-service.svc.cluster.local:9092 \
            --topic test \
            --from-beginning
五、查看创建的kafka
### --- 查看创建的kafka

[root@k8s-master01 kafka]# kubectl get po -n public-service -owide
NAME                              READY   STATUS    RESTARTS   AGE     IP               NODE           NOMINATED NODE   READINESS GATES
kafka-0                           1/1     Running   0          76s     172.25.244.203   k8s-master01   <none>           <none>
zookeeper-0    1/1     Running   0          11m     172.25.244.201   k8s-master01   <none>           <none>  
六、查看创建的kafka的service资源
### --- 查看创建的service

[root@k8s-master01 kafka]# kubectl get svc -n public-service -owide
NAME                    TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                      AGE     SELECTOR
kafka                   ClusterIP   10.98.0.73       <none>        9092/TCP                     2m32s   app.kubernetes.io/component=kafka,app.kubernetes.io/instance=kafka,app.kubernetes.io/name=kafka
kafka-headless          ClusterIP   None             <none>        9092/TCP,9093/TCP            2m32s   app.kubernetes.io/component=kafka,app.kubernetes.io/instance=kafka,app.kubernetes.io/name=kafka
kibana-logging          NodePort    10.97.92.222     <none>        5601:30495/TCP               3h57m   k8s-app=kibana-logging

 
 
 
 
 
 
 
 
 

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart
                                                                                                                                                   ——W.S.Landor

 

 

posted on   yanqi_vip  阅读(36)  评论(0编辑  收藏  举报

相关博文:
阅读排行:
· 全程不用写代码,我用AI程序员写了一个飞机大战
· MongoDB 8.0这个新功能碉堡了,比商业数据库还牛
· 记一次.NET内存居高不下排查解决与启示
· DeepSeek 开源周回顾「GitHub 热点速览」
· 白话解读 Dapr 1.15:你的「微服务管家」又秀新绝活了
< 2025年3月 >
23 24 25 26 27 28 1
2 3 4 5 6 7 8
9 10 11 12 13 14 15
16 17 18 19 20 21 22
23 24 25 26 27 28 29
30 31 1 2 3 4 5

导航

统计

点击右上角即可分享
微信分享提示