Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-7331

Test and certify col stats integration with MOR table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • metadata
    • None

    Description

      Lets test and certify col stats integration with MOR table for all operations.

      for eg, any write operations (bulk insert, insert, upsert, insert overwrite) should add new entries to col stats index in metadata table. 

      rollback: 

      for files that were deleted should be removed from col stats (data files). 

      for log files added, we should add new entries to col stats 

       

      clean: 

      any files deleted (data files and log files) should have the entries removed from col stats in MDT. 

       

      Similarly, lets also do similar exercise with delete partition and other operations we have with hudi. 

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            shivnarayan sivabalan narayanan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: