XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • tests-ci
    • None

    Description

      We need tests added to 0.16.0 hudi to ensure it can read 1.x tables. 

       

      We should have good coverage for all new log formats, diff table types, pending compactions, pending clustering, completed clustering, failed commits/delta commits, pending rollbacks, pending cleans etc. diff payloads, key gen, partitioned/non-partitioned. regular index and global index.

      Cover all different writers:

      a. spark ds writer

      b. spark sql

      c. deltastreamer 

      d. spark streaming writer 

       

       

       

      Reader side validation:

      lets account for snapshot read, incremental read, time travel read. 

       

      Attachments

        Issue Links

          Activity

            People

              shivnarayan sivabalan narayanan
              shivnarayan sivabalan narayanan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: