Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-648

Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

    XMLWordPrintableJSON

Details

    Description

      We would like a way to hand the erroring records from writing or compaction back to the users, in a separate table or log. This needs to work generically across all the different writer paths.

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HUDI-944 Support more complete concurrency control when writing data

          • Major - Major loss of function.
          • Closed
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HUDI-5813 Add Error table support for error events

          • Major - Major loss of function.
          • Closed
          is a parent of

          New Feature - A new feature of the product, which has yet to be developed. HUDI-1505 Allow pluggable option to write error records to side table, queue

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-5207 Add error handling logic flow for WriteStatus in spark sql writer

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #2710

          Web Link GitHub Pull Request #3308

          Web Link GitHub Pull Request #3309

          Web Link GitHub Pull Request #3312

          mentioned in

          Page Loading...

          Activity

            People

              liujinhui liujinhui
              vinoth Vinoth Chandar
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: