Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14841 Replication - Phase 2
  3. HIVE-16990

REPL LOAD should update last repl ID only after successful copy of data files.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.1.0
    • 3.0.0
    • Hive, repl

    Description

      For REPL LOAD operations that includes both metadata and data changes should follow the below rule.
      1. Copy the metadata excluding the last repl ID.
      2. Copy the data files
      3. If Step 1 and 2 are successful, then update the last repl ID of the object.
      This rule will allow the the failed events to be re-applied by REPL LOAD and ensures no data loss due to failures.

      Attachments

        1. HIVE-16990.01.patch
          57 kB
          Sankar Hariappan
        2. HIVE-16990.02.patch
          61 kB
          Sankar Hariappan
        3. HIVE-16990.03.patch
          60 kB
          Sankar Hariappan
        4. HIVE-16990.04.patch
          65 kB
          Sankar Hariappan
        5. HIVE-16990.05.patch
          64 kB
          Sankar Hariappan

        Issue Links

          Activity

            People

              sankarh Sankar Hariappan
              sankarh Sankar Hariappan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: