Details
-
Improvement
-
Status: Open
-
Blocker
-
Resolution: Unresolved
-
None
-
None
-
None
Description
if hoodie.keep.max.commits <= hoodie.cleaner.commits.retained, then cleaner will never kick in only. Bcoz, by then archival will kick in and will move entries from active to archived.
We need to revisit this and either throw exception or make cleaner also look into archived commits.
Related issue: https://github.com/apache/hudi/issues/3739