Details
-
New Feature
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
This patch adds multiple record writers to allow Hive user writing data directly to a Kafka Topic.
The end goal is have a writer that provides multiple write semantics modes.
-
- A BEST_EFFORT where all the records will be delivered with no guarantee or reties eg best effort mode. (Done)-
- B At_least_once, each record will be delivered with retries from the Kafka Producer and Hive Write Task. (Done)
- C Exactly_once , Writer will be using Kafka Transaction API to ensure that each record is delivered once. (not so, still need more discussions)
In addition to the new feature i have refactored the existing code to make it more readable.
Attachments
Attachments
Issue Links
- links to
There are no Sub-Tasks for this issue.