Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14336 Procedure V2 Phase 1 - Procedure Framework and Making DDL Operations fault tolerant
  3. HBASE-13529

Procedure v2 - WAL Improvements

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 1.1.0, 2.0.0
    • 1.1.0, 2.0.0
    • proc-v2
    • None

    Description

      from the discussion in HBASE-12439 the wal was resulting slow.

      • there is an error around the awake of the slotCond.await(), causing more wait then necessary
      • ArrayBlockingQueue is dog slow, replace it with ConcurrentLinkedQueue
      • roll the wal only if reaches a threshold (conf ops) to amortize the cost
      • hsync() is used by default, when the normal wal is using just hflush() make it tunable via conf

      Attachments

        1. HBASE-13529-v2.patch
          11 kB
          Matteo Bertozzi
        2. HBASE-13529-v1.patch
          9 kB
          Matteo Bertozzi
        3. ProcedureStoreTest.java
          7 kB
          Matteo Bertozzi
        4. HBASE-13529-v0.patch
          7 kB
          Matteo Bertozzi

        Activity

          People

            mbertozzi Matteo Bertozzi
            mbertozzi Matteo Bertozzi
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: