[FLINK-31953] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source - ASF JIRA

XML

Word

Printable

JSON

Release Note:
In kafka-3.1.0, we enable partition discovery by default and set EARLIEST offset strategy for later discovered partitions.
Flags:

Important
External issue URL:
https://cwiki.apache.org/confluence/display/FLINK/FLIP-288%3A+Enable+Dynamic+Partition+Discovery+by+Default+in+Kafka+Source
Language:
- Java

This improvement implements FLIP-288.

this Flip has there main objectives:

Organize the code logic of the current built-in OffsetsInitializer, then modify the JavaDoc to let users know.

Each objective corresponds to a sub-task

1.	EARLIEST offset strategy for partitions discoveried later based on FLIP-288	Closed	Hongshun Wang
2.	Enable Dynamic Partition Discovery by Default in Kafka Source based on FLIP-288	Closed	Hongshun Wang
3.	Improvement the Javadoc for SpecifiedOffsetsInitializer and TimestampOffsetsInitializer.	Closed	Hongshun Wang
4.	Update document of Kafka Source: Enable Dynamic Partition Discovery by Default in Kafka Source	Closed	Hongshun Wang