Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2511

Aggressive archival configs compared to cleaner configs make cleaning moot

    XMLWordPrintableJSON

Details

    Description

      if hoodie.keep.max.commits <= hoodie.cleaner.commits.retained, then cleaner will never kick in only. Bcoz, by then archival will kick in and will move entries from active to archived. 

      We need to revisit this and either throw exception or make cleaner also look into archived commits. 

      Related issue: https://github.com/apache/hudi/issues/3739

       

      Attachments

        Activity

          People

            shivnarayan sivabalan narayanan
            shivnarayan sivabalan narayanan
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: