Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2170

Always choose the latest record for HoodieRecordPayload

    XMLWordPrintableJSON

Details

    Description

      Now in OverwriteWithLatestAvroPayload.preCombine, we still choose the old record when the new record has the same preCombine field with the old one, actually it is more natural to keep the new incoming record instead. The DefaultHoodieRecordPayload.combineAndGetUpdateValue method already did that.

      See issue: https://github.com/apache/hudi/issues/3266.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HUDI-1763 DefaultHoodieRecordPayload does not honor ordering value when records within multiple log files are merged

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          links to

          Web Link GitHub Pull Request #3267

          Web Link GitHub Pull Request #3401

          Activity

            People

              danny0405 Danny Chen
              danny0405 Danny Chen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: