CDH5.16.1的kafka集群报错: No broker in ISR for partition [getngo_collect_apm_test,0]

1 详细错误

?

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43

kafka.common.NoReplicaOnlineException: No broker in ISR for partition [getngo_collect_apm_test,0] is alive. Live brokers are: [Set(112, 113, 114, 115)], ISR brokers are: [116]         at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:66)         at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:342)         at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:203)         at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:118)         at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:115)         at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)         at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)         at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)         at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)         at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)         at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)         at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732)         at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:115)         at kafka.controller.KafkaController.onBrokerStartup(KafkaController.scala:440)         at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(ReplicaStateMachine.scala:374)         at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1$$anonfun$apply$mcV$sp$1.apply(ReplicaStateMachine.scala:358)         at kafka.controller.ReplicaStateMachine$BrokerChangeListener$$anonfun$handleChildChange$1$$anonfun$apply$mcV$sp$1.apply(ReplicaStateMachine.scala:358)                                                                                                                              22332,1       99%         at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)         at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)         at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)         at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732)         at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:115)         at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)         at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:343)         at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:167)         at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)         at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:50)         at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply(ZookeeperLeaderElector.scala:48)         at kafka.server.ZookeeperLeaderElector$$anonfun$startup$1.apply(ZookeeperLeaderElector.scala:48)         at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:231)         at kafka.server.ZookeeperLeaderElector.startup(ZookeeperLeaderElector.scala:48)         at kafka.controller.KafkaController$$anonfun$startup$1.apply$mcV$sp(KafkaController.scala:683)         at kafka.controller.KafkaController$$anonfun$startup$1.apply(KafkaController.scala:679)         at kafka.controller.KafkaController$$anonfun$startup$1.apply(KafkaController.scala:679)         at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:231)         at kafka.controller.KafkaController.startup(KafkaController.scala:679)         at kafka.server.KafkaServer.startup(KafkaServer.scala:202)         at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:37)         at kafka.Kafka$.main(Kafka.scala:67)         at com.cloudera.kafka.wrap.Kafka$.main(Kafka.scala:76)         at com.cloudera.kafka.wrap.Kafka.main(Kafka.scala)

2 查了下网上说是选举出问题了。自己因为是在重启集群，所以出现了上述报错。但是稳定运行一段时间后，不再报错。kakfa版本是CDH版本的0.10版本的kafka。