Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8241

Spark SQL MIT global index change partition paths will not work with custom merger

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • 1.0.0
    • spark-sql
    • None

    Description

      We use avro record merger so we can use expression payload, and we overwrite the merger impls. There might be some changes to how we do merger impls so I don't want to address this issue yet. 

      If overwrite or event time is used it is fine because we just use the payload based merging. But if they have a custom merger, then we need to use that when reading the records

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jonvex Jonathan Vexler
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: