kafka生产者参数优化 lua-resty-kafka:buffer overflow while logging request

 

KAFKA参数调优实战,看这篇文章就够了!https://www.cnblogs.com/technologykai/articles/10875480.html

kafka生产者使用不当导致的应用挂起/夯住 https://www.jianshu.com/p/45258f744425

 

https://github.com/doujiang24/lua-resty-kafka

 

Error:buffer overflow while logging request

https://github.com/doujiang24/lua-resty-kafka/issues/76

优化参数:

  • batch_num

    Specifies the batch.num.messages. Default 200.

  • batch_size

    Specifies the send.buffer.bytes. Default 1M(may reach 2M). Be careful, SHOULD be smaller than the socket.request.max.bytes / 2 - 10k config in kafka server.

  • max_buffering

    Specifies the queue.buffering.max.messages. Default 50,000.

posted @ 2022-03-10 18:49  JeromePowell  阅读(292)  评论(0编辑  收藏  举报