Details
Description
Committing in Kafka Streams happens in regular intervals. However, committing only happens if new input records got processed since the last commit (via setting flag `commitOffsetNeeded` within `StreamTask#process()`)
However, data could also be emitted via wall-clock based punctuation calls. Especially if EOS is enabled, this is an issue (maybe also for non-EOS) because the current running transaction is not committed and thus might time out leading to a fatal error.
Attachments
Issue Links
- duplicates
-
KAFKA-6838 Transaction timeout after punctuation results in ProducerFencedException
- Resolved
- relates to
-
KAFKA-5510 Streams should commit all offsets regularly
- Resolved
- links to