Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20188 Evaluate and address performance delta between branch-1 and branch-2
  3. HBASE-20483

[PERFORMANCE] Flushing is 2x slower in hbase2.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.1
    • Performance
    • None

    Description

      When flush is slow, memstores backup and go slower. See "1.2.7 vs. 2.0.0 Flush History" https://docs.google.com/spreadsheets/d/1sihTxb4aCplR3Rr_GGXkPlwhMIm-CbB9j_5339AS0Zc/edit#gid=1016758826 for compare. First noted by anoop.hbase

      Attachments

        1. SnapshotSegmentScanner_2.0.0.patch
          2 kB
          Michael Stack
        2. PerpetualFlushingProgram.patch
          22 kB
          Michael Stack
        3. PerpetualFlushingProgram1.2.patch
          9 kB
          Michael Stack
        4. 0001-HBASE-20483-perpetual-flush.branch-1.4.patch
          9 kB
          Michael Stack
        5. 0001-HBASE-20483-perpertual-flush-and-memstore-fill-branch-2.0.patch
          26 kB
          Michael Stack
        6. 0001-HBASE-20483-perpetual-flush.branch-1.4.patch
          9 kB
          Michael Stack
        7. 0001-HBASE-20483-perpetual.tests.patch
          27 kB
          Michael Stack
        8. 0001-HBASE-20483-perpetual.tests.patch
          27 kB
          Michael Stack
        9. 0001-Perpetual-flush-memstore-fill-etc.-tools.patch
          21 kB
          Michael Stack

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HBASE-20628 SegmentScanner does over-comparing when one flushing

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link Reports on flushing before and after

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: