Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14841 Replication - Phase 2
  3. HIVE-17428

REPL LOAD of ALTER_PARTITION event doesn't create import tasks if the partition doesn't exist during analyze phase.

    XMLWordPrintableJSON

Details

    Description

      If the incremental dump event sequence have ADD_PARTITION followed by ALTER_PARTITION doesn't create any task for ALTER_PARTITION event as the partition doesn't exist during analyze phase. Due to this REPL STATUS returns wrong last repl ID.
      Scenario:
      1. Create DB
      2. Create partitioned table.
      3. Bootstrap dump and load
      4. Insert into table to a dynamically created partition. - This insert generate ADD_PARTITION and ALTER_PARTITION events.
      5. Incremental dump and load.

      • Load will be successful.
      • But the last repl ID set was incorrect as ALTER_PARTITION event was never applied.

      Attachments

        1. HIVE-17428.01.patch
          13 kB
          Sankar Hariappan
        2. HIVE-17428.02.patch
          20 kB
          Sankar Hariappan
        3. HIVE-17428.03.patch
          22 kB
          Sankar Hariappan

        Issue Links

          Activity

            People

              sankarh Sankar Hariappan
              sankarh Sankar Hariappan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: