Details
-
Sub-task
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
None
Description
The consumer needs to be polled at a candance lower than MAX_POLL_INTERVAL_MAX otherwise the consumer should try to leave the group. Currently, we send an acknowledgment event to the network thread per poll. The event only triggers update on autocommit state, we need to implement updating the poll timer so that the consumer can leave the group when the timer expires.
The current logic looks like this:
if (heartbeat.pollTimeoutExpired(now)) { // the poll timeout has expired, which means that the foreground thread has stalled // in between calls to poll(). log.warn("consumer poll timeout has expired. This means the time between subsequent calls to poll() " + "was longer than the configured max.poll.interval.ms, which typically implies that " + "the poll loop is spending too much time processing messages. You can address this " + "either by increasing max.poll.interval.ms or by reducing the maximum size of batches " + "returned in poll() with max.poll.records."); maybeLeaveGroup("consumer poll timeout has expired."); }
Attachments
Issue Links
- links to