Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20708

Remove the usage of RecoverMetaProcedure in master startup

    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Introduce an InitMetaProcedure to initialize meta table for a new HBase deploy. Marked RecoverMetaProcedure deprecated and remove the usage of it in the current code base. We still need to keep it in place for compatibility. The code in RecoverMetaProcedure has been moved to ServerCrashProcedure, and SCP will always be enabled and we will rely on it to bring meta region online.

      For more on the issue addressed by this commit, see the design doc for overview and plan: https://docs.google.com/document/d/1_872oHzrhJq4ck7f6zmp1J--zMhsIFvXSZyX1Mxg5MA/edit#heading=h.xy1z4alsq7uy
      Show
      Introduce an InitMetaProcedure to initialize meta table for a new HBase deploy. Marked RecoverMetaProcedure deprecated and remove the usage of it in the current code base. We still need to keep it in place for compatibility. The code in RecoverMetaProcedure has been moved to ServerCrashProcedure, and SCP will always be enabled and we will rely on it to bring meta region online. For more on the issue addressed by this commit, see the design doc for overview and plan: https://docs.google.com/document/d/1_872oHzrhJq4ck7f6zmp1J--zMhsIFvXSZyX1Mxg5MA/edit#heading=h.xy1z4alsq7uy

    Description

      In HBASE-20700, we make RecoverMetaProcedure use a special lock which is only used by RMP to avoid dead lock with MoveRegionProcedure. But we will always schedule a RMP when master starting up, so we still need to make sure that there is no race between this RMP and other RMPs and SCPs scheduled before the master restarts.

      Please see #[accompanying design document where we call out the problem being addressed by this issue in more detail and in which we describe our new approach to Master startup.

      Attachments

        1. HBASE-20708-v9.patch
          141 kB
          Duo Zhang
        2. HBASE-20708-v9.patch
          141 kB
          Duo Zhang
        3. HBASE-20708-v8.patch
          132 kB
          Duo Zhang
        4. HBASE-20708-v7.patch
          126 kB
          Duo Zhang
        5. HBASE-20708-v6.patch
          125 kB
          Duo Zhang
        6. HBASE-20708-v5.patch
          120 kB
          Duo Zhang
        7. HBASE-20708-v4.patch
          117 kB
          Duo Zhang
        8. HBASE-20708-v3.patch
          115 kB
          Duo Zhang
        9. HBASE-20708-v2.patch
          111 kB
          Duo Zhang
        10. HBASE-20708-v1.patch
          111 kB
          Duo Zhang
        11. HBASE-20708.patch
          103 kB
          Duo Zhang

        Issue Links

          blocks

          Sub-task - The sub-task of the issue HBASE-20747 Cut branch-2.1

          • Major - Major loss of function.
          • Closed
          breaks

          Bug - A problem which impairs or prevents the functions of the product. HBASE-20775 TestMultiParallel is flakey

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HBASE-20700 Move meta region when server crash can cause the procedure to be stuck

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Sub-task - The sub-task of the issue HBASE-20976 SCP can be scheduled multiple times for the same RS

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-19287 master hangs forever if RecoverMeta send assign meta region request to target server fail

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-19998 Flakey TestVisibilityLabelsWithDefaultVisLabelService

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-20742 Always create WAL directory for region server

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-20739 Add priority for SCP

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-20987 Evalate backport of HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Design Doc

          Web Link Review Board

          There are no Sub-Tasks for this issue.

          Activity

            People

              zhangduo Duo Zhang
              zhangduo Duo Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: