Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2231

Compaction events should be written to HLog

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      The sequence for a compaction should look like this:

      1. Compact region to "new" files
      2. Write a "Compacted Region" entry to the HLog
      3. Delete "old" files

      This deals with a case where the RS has paused between step 1 and 2 and the regions have since been reassigned.

      Attachments

        1. hbase-2231-testcase.txt
          14 kB
          Todd Lipcon
        2. hbase-2231.txt
          42 kB
          Todd Lipcon
        3. 2231-testcase-0.94.txt
          12 kB
          Ted Yu
        4. 2231v2.txt
          4 kB
          Michael Stack
        5. 2231-testcase_v2.txt
          8 kB
          Michael Stack
        6. 2231-testcase_v3.txt
          14 kB
          Michael Stack
        7. 2231v3.txt
          59 kB
          Michael Stack
        8. 2231v4.txt
          102 kB
          Michael Stack
        9. hbase-2231_v5.patch
          118 kB
          Enis Soztutar
        10. hbase-2231_v6.patch
          118 kB
          Enis Soztutar
        11. hbase-2231_v7.patch
          118 kB
          Enis Soztutar
        12. hbase-2231_v7.patch
          118 kB
          Enis Soztutar
        13. hbase-2231_v7-0.95.patch
          112 kB
          Enis Soztutar
        14. hbase-2231_v7-addendum.patch
          1 kB
          Enis Soztutar
        15. hbase-2231_v8-addendum.patch
          1 kB
          Michael Stack

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HBASE-8478 HBASE-2231 breaks TestHRegion#testRecoveredEditsReplayCompaction under hadoop2 profile

          • Major - Major loss of function.
          • Closed
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HBASE-3604 Two region servers think that they own the same region: data loss

          • Major - Major loss of function.
          • Closed
          is related to

          Umbrella - An overarching type made of sub-tasks HBASE-2238 Review all transitions -- compactions, splits, region opens, log roll/splitting -- for crash-proofyness and atomicity

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HBASE-18786 FileNotFoundException should not be silently handled for primary region replicas

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-27349 HBase FileNotFound Exception After Region Transitioned

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HBASE-2519 StoreFileScanner.seek swallows IOEs

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              stack Michael Stack
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: