Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-6872

Simplify Out Of Box Schema Evolution Functionality

    XMLWordPrintableJSON

Details

    Description

      Test schema evolution capabilities out of the box for deltastreamer and datasource. Make schema evolution out of the box easy to understand and use

      Attachments

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. HUDI-6957 Allow column re-ordering for schema on write

          • Major - Major loss of function.
          • Open
          causes

          Bug - A problem which impairs or prevents the functions of the product. HUDI-7327 hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSource unless meta cols are dropped

          • Major - Major loss of function.
          • Closed
          is a parent of

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-6955 Fail the delta streamer pipeline on re-ordering of columns

          • Critical - Crashes, loss of data, severe memory leak.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-6947 Clean up HoodieSparkSqlWriter.deduceWriterSchema

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-6958 Update Schema Evolution Documentation

          • Major - Major loss of function.
          • Closed
          Testing discovered

          Bug - A problem which impairs or prevents the functions of the product. HUDI-6873 Clustering MOR applies base files after log files

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HUDI-6948 HoodieAvroParquetReader sets configs wrong (and prevents schema evolution with non row writer)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #9743

          Web Link GitHub Pull Request #10028

          Web Link GitHub Pull Request #10034

          Web Link GitHub Pull Request #10041

          Web Link GitHub Pull Request #10042

          Activity

            People

              jonvex Jonathan Vexler
              jonvex Jonathan Vexler
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: