Brokers类型配置

 

引用博客来自李志涛：https:////www.cnblogs.com/lizherui/p/12056760.html

 

模块	配置项	作用域	备注
DynamicConnectionQuota	max.connections max.connections.per.ip max.connections.per.ip.overrides	All brokers或brokerId	服务端最大连接数限制 客户端每个ip最大连接数限制 客户端每个具体ip最大连接数量限制，格式为：100.127.0.0.1:200,100,127.0.0.2:200,...
DynamicListenerConfig	Listener configs listeners advertised.listeners listener.security.protocol.map SSL configs principal.builder.class ssl.protocol ssl.provider ssl.cipher.suites ssl.enabled.protocols ssl.keystore.type ssl.keystore.location ssl.keystore.password ssl.key.password ssl.truststore.type ssl.truststore.location ssl.truststore.password ssl.keymanager.algorithm ssl.trustmanager.algorithm ssl.endpoint.identification.algorithm ssl.secure.random.implementation ssl.client.auth SASL configs sasl.mechanism.inter.broker.protocol sasl.jaas.config sasl.enabled.mechanisms sasl.kerberos.service.name sasl.kerberos.kinit.cmd sasl.kerberos.ticket.renew.window.factor sasl.kerberos.ticket.renew.jitter sasl.kerberos.min.time.before.relogin sasl.kerberos.principal.to.local.rules sasl.login.refresh.window.factor sasl.login.refresh.window.jitter sasl.login.refresh.min.period.seconds sasl.login.refresh.buffer.seconds	All brokers或brokerId
DynamicLogConfig	log.segment.bytes (segment.bytes) log.roll.ms, log.roll.hours (segment.ms) log.roll.jitter.ms, log.roll.jitter.hours (segment.jitter.ms) log.index.size.max.bytes (segment.index.bytes) log.flush.interval.messages (flush.messages) log.flush.interval.ms (flush.ms) log.retention.bytes (retention.bytes) log.retention.ms, log.retention.minutes, log.retention.hours (retention.ms) message.max.bytes(max.message.bytes) log.index.interval.bytes (index.interval.bytes) log.cleaner.delete.retention.ms (delete.retention.ms) log.cleaner.min.compaction.lag.ms (min.compaction.lag.ms) log.cleaner.min.cleanable.ratio (min.cleanable.dirty.ratio) log.cleanup.policy (cleanup.policy) log.segment.delete.delay.ms (file.delete.delay.ms) unclean.leader.election.enable (unclean.leader.election.enable) min.insync.replicas (min.insync.replicas) max.message.bytes (max.message.bytes) compression.type (compression.type) log.preallocate (preallocate) log.message.timestamp.type (message.timestamp.type) log.message.timestamp.difference.max.ms (message.timestamp.difference.max.ms) log.message.downconversion.enable(message.downconversion.enable)	All brokers或brokerId	log.segment.bytes (segment.bytes) log.segment.bytes为brokers类型配置 segment.bytes为topics类型配置，其他同理
DynamicLogCleaner	log.cleaner.threads log.cleaner.dedupe.buffer.size log.cleaner.io.buffer.load.factor log.cleaner.io.buffer.size log.cleaner.io.max.bytes.per.second log.cleaner.backoff.ms	All brokers或brokerId
DynamicMetricsReporters	metric.reporters	All brokers或brokerId	Kafka提供了Metrics Reporter的插件扩展功能，默认提供了JmxReporter实现，也即我们已经可以通过JMX工具来查看Kafka的Metrics。所以我们可以自己实现一套Metrics Reporter（实现org.apache.kafka.common.metrics.MetricsReporter），来自定义获取这些Metrics。
DynamicThreadPool	num.io.threads num.network.threads num.replica.fetchers num.recovery.threads.per.data.dir background.threads	All brokers或brokerId	新线程池数量公式： newValue > oldValue / 2 && newValue <= oldValue * 2 当指定线程池数量大于运行时，就会创建扩容，当小于时，就会销毁收缩
DynamicReplicationQuota	leader.replication.throttled.rate follower.replication.throttled.rate replica.alter.log.dirs.io.max.bytes.per.second	仅用于brokerId	限制leader副本端处理FETCH请求的每秒流量上限，单位为bytes/sec，表示最高为xxx bytes/sec 限制follower副本发送FETCH请求的每秒流量上限，单位为bytes/sec，表示最高为xxx bytes/sec 限制磁盘内目录之间拷贝迁移每秒流量上限，单位bytes/sec，表示最高为xxx bytes/sec