Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1456

[UMBRELLA] Concurrency Control for Hudi writers and table services

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • 0.9.0
    • 1.0.0
    • writer-core
    • None
    • Multi-writer & OCC

    Description

      This ticket tracks all the changes needed to support concurrency control for Hudi tables. This work will be done in multiple phases. 

      1. Parallel writing to Hudi tables support -> This feature will allow users to have multiple writers mutate the tables without the ability to perform concurrent update to the same file. 
      2. Concurrency control at file/record level -> This feature will allow users to have multiple writers mutate the tables with the ability to ensure serializability at record level.

      Attachments

        Issue Links

          is a parent of

          Bug - A problem which impairs or prevents the functions of the product. HUDI-1709 Improve lock config naming convention and add hive metastore uri config

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HUDI-845 Allow parallel writing to Hudi tables using Locking service

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HUDI-944 Support more complete concurrency control when writing data

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-1486 Remove pending rollback and move to cleaner

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HUDI-1679 Add example to docker for optimistic lock use

          • Major - Major loss of function.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. HUDI-5197 Support Java client

          • Major - Major loss of function.
          • Open

          Activity

            People

              nishith29 Nishith Agarwal
              nishith29 Nishith Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: