Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-5722

Re-think restore for MOR table

    XMLWordPrintableJSON

Details

    Description

      As of now, our restore is triggering N rollbacks in reverse chronological order. 

      for MOR table, we need to re-think this, since our rollbacks are log appends, even if we want to restore to a delta commit just before last compaction, instead of directly cleaning up the lastest file slice, we are triggering rollbacks of N delta commits and finally cleaning up the entire file slice when the compaction instant is being rolledback. 

       

      we can optimize things better here for MOR table. we just need to re-think restore from scratch w/o the need for going thru N rollbacks. 

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            shivnarayan sivabalan narayanan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: