[HUDI-5493] Revisit the archival process wrt clustering - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Critical
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: 1.1.0
Component/s: archiving, clustering, table-service
Labels:
- release-0.14.0-blocker

Description

https://github.com/apache/hudi/pull/7568

The above PR fixes the case where the archival of a clustering replacecommit can lead to duplicate data when both the replaced and new file groups from the replacecommit co-exist in the Hudi table.

The new logic is complex. We need to simplify the archival process.

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Ethan Guo (this is the old account; please use "yihua")

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 03/Jan/23 19:53

Updated:: 28/Mar/24 01:05