kafka 消费报错

具体报错信息Traceback (most recent call last):
File "/root/kafkatomysql.py", line 166, in <module>
consumer.commit()
File "/usr/local/python3.9/lib/python3.9/site-packages/kafka/consumer/group.py", line 527, in commit
self._coordinator.commit_offsets_sync(offsets)
File "/usr/local/python3.9/lib/python3.9/site-packages/kafka/coordinator/consumer.py", line 521, in commit_offsets_sync
raise future.exception # pylint: disable-msg=raising-bad-type
kafka.errors.CommitFailedError: CommitFailedError: Commit cannot be completed since the group has already
rebalanced and assigned the partitions to another member.
This means that the time between subsequent calls to poll()
was longer than the configured max_poll_interval_ms, which
typically implies that the poll loop is spending too much
time message processing. You can address this either by
increasing the rebalance timeout with max_poll_interval_ms,
or by reducing the maximum size of batches returned in poll()
with max_poll_records.

 

这个报错主要是消费消息时间超过了max_poll_interval_ms时间，目前策略是把max_poll_interval_ms时间调大，并且，增加了守护进程，观测日志看还会不会报错。