Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12439

Procedure V2

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Implemented
    • 2.0.0
    • None
    • master

    Description

      Procedure v2 (aka Notification Bus) aims to provide a unified way to build:

      • multi-steps procedure with a rollback/rollforward ability in case of failure (e.g. create/delete table)
      • notifications across multiple machines (e.g. ACLs/Labels/Quotas cache updates)
        • Make sure that every machine has the grant/revoke/label
        • Enforce "space limit" quota across the namespace
        • HBASE-10295 eliminate permanent replication zk node
      • procedures across multiple machines (e.g. Snapshots)
      • coordinated long-running procedures (e.g. compactions, splits, ...)
      • Synchronous calls, with the ability to see the state/result in case of failure.

      still work in progress/initial prototype: https://reviews.apache.org/r/27703/

      Attachments

        1. Procedurev2Notification-Bus.pdf
          294 kB
          Matteo Bertozzi
        2. Procedurev2Notification-BusRoadmap.pdf
          158 kB
          Michael Stack
        3. ProcedureV2b.pdf
          176 kB
          Michael Stack

        Issue Links

          contains

          Task - A task that needs to be done. HBASE-14350 Procedure V2 Phase 2: Assignment Manager

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Task - A task that needs to be done. HBASE-15141 Procedure V2 - Web UI

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Task - A task that needs to be done. HBASE-14336 Procedure V2 Phase 1 - Procedure Framework and Making DDL Operations fault tolerant

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HBASE-14351 Procedure V2 Phase 3: Notification Bus

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HBASE-14353 Procedure V2 Phase 1.1 - cleanups and master-branch-only DDL updates (incompatible with branch-1.x)

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HBASE-16100 Procedure V2 - Tools

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Umbrella - An overarching type made of sub-tasks HBASE-16617 Procedure V2 - Improvements

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-17788 Procedure V2 performance improvements

          • Major - Major loss of function.
          • Closed
          links to

          Web Link Pv2 for Devs

          Activity

            People

              Unassigned Unassigned
              mbertozzi Matteo Bertozzi
              Votes:
              0 Vote for this issue
              Watchers:
              42 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: