Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20828 Finish-up AMv2 Design/List of Tenets/Specification of operation
  3. HBASE-20878

Data loss if merging regions while ServerCrashProcedure executing

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.0.0-alpha-1, 2.1.0, 2.0.1
    • 3.0.0-alpha-1, 2.2.0, 2.1.1, 2.0.2
    • amv2
    • None

    Description

      In MergeTableRegionsProcedure, we close the regions to merge using UnassignProcedure. But, if the RS these regions on is crashed, a ServerCrashProcedure will execute at the same time. UnassignProcedures will be blockd until all logs are split. But since these regions are closed for merging, the regions won't open again, the recovered.edit in the region dir won't be replay, thus, data will loss.
      I provided a test to repo this case. I seriously doubt Split region procedure also has this kind of problem. I will check later

      Attachments

        1. HBASE-20878.branch-2.0.001.patch
          9 kB
          Allan Yang
        2. HBASE-20878.branch-2.0.002.patch
          9 kB
          Allan Yang
        3. HBASE-20878.branch-2.0.003.patch
          10 kB
          Allan Yang
        4. HBASE-20878.branch-2.0.004.patch
          9 kB
          Allan Yang
        5. HBASE-20878.branch-2.0.004.patch
          9 kB
          Michael Stack

        Activity

          People

            allan163 Allan Yang
            allan163 Allan Yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: