Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9675 Support START TRANSACTION/COMMIT/ROLLBACK commands
  3. HIVE-11030

Enhance storage layer to create one delta file per write

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.3.0
    • Transactions
    • None

    Description

      Currently each txn using ACID insert/update/delete will generate a delta directory like delta_0000100_0000101. In order to support multi-statement transactions we must generate one delta per operation within the transaction so the deltas would be named like delta_0000100_0000101_0001, etc.

      Support for MERGE (HIVE-10924) would need the same.

      Attachments

        1. HIVE-11030.2.patch
          72 kB
          Eugene Koifman
        2. HIVE-11030.3.patch
          69 kB
          Eugene Koifman
        3. HIVE-11030.4.patch
          82 kB
          Eugene Koifman
        4. HIVE-11030.5.patch
          82 kB
          Eugene Koifman
        5. HIVE-11030.6.patch
          83 kB
          Eugene Koifman
        6. HIVE-11030.7.patch
          83 kB
          Eugene Koifman
        7. HIVE-11030.8.branch1.patch
          81 kB
          Eugene Koifman
        8. HIVE-11030.8.patch
          82 kB
          Eugene Koifman

        Issue Links

          blocks

          Sub-task - The sub-task of the issue HIVE-11077 Add support in parser and wire up to txn manager

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-10924 add support for MERGE statement

          • Major - Major loss of function.
          • Resolved
          breaks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12202 NPE thrown when reading legacy ACID delta files

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-10165 Improve hive-hcatalog-streaming extensibility and support updates and deletes.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ekoifman Eugene Koifman
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: