Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15594 [YCSB] Improvements
  3. HBASE-15971

Regression: Random Read/WorkloadC slower in 1.x than 0.98

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.3.0, 2.0.0
    • 1.3.0, 2.0.0
    • rpc, Scheduler
    • None
    • Incompatible change, Reviewed
    • Hide
      Change the default rpc scheduler from 'deadline' to 'fifo' instead so it is the same as in branch 0.98. 'deadline' was of questionable benefit but with a high cost scheduling. To re-enable 'deadline', set hbase.ipc.server.callqueue.type to 'deadline' in your hbase-site.xml.
      Show
      Change the default rpc scheduler from 'deadline' to 'fifo' instead so it is the same as in branch 0.98. 'deadline' was of questionable benefit but with a high cost scheduling. To re-enable 'deadline', set hbase.ipc.server.callqueue.type to 'deadline' in your hbase-site.xml.

    Description

      branch-1 is slower than 0.98 doing YCSB random read/workloadC. It seems to be doing about 1/2 the throughput of 0.98.

      In branch-1, we have low handler occupancy compared to 0.98. Hacking in reader thread occupancy metric, is about the same in both. In parent issue, hacking out the scheduler, I am able to get branch-1 to go 3x faster so will dig in here.

      Attachments

        1. HBASE-15971.branch-1.002.patch
          6 kB
          Michael Stack
        2. flight_recording_10172402220203_28.branch-1.jfr
          9.02 MB
          Michael Stack
        3. flight_recording_10172402220203_29.09820.0.98.20.jfr
          12.42 MB
          Michael Stack
        4. Screen Shot 2016-06-10 at 5.08.24 PM.png
          1.02 MB
          Michael Stack
        5. Screen Shot 2016-06-10 at 5.08.26 PM.png
          527 kB
          Michael Stack
        6. run_ycsb.sh
          7 kB
          Michael Stack
        7. hits.patched1.0.vs.unpatched1.0.vs.098.png
          16 kB
          Michael Stack
        8. handlers.fp.png
          25 kB
          Michael Stack
        9. hits.fp.png
          16 kB
          Michael Stack
        10. HBASE-15971.branch-1.001.patch
          23 kB
          Michael Stack
        11. 098.png
          26 kB
          Michael Stack
        12. branch-1.png
          31 kB
          Michael Stack
        13. branch-1.hits.png
          15 kB
          Michael Stack
        14. 098.hits.png
          19 kB
          Michael Stack

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-14479 Apply the Leader/Followers pattern to RpcServer's Reader

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. HBASE-15619 Performance regression observed: Empty random read(get) performance of branch-1 worse than 0.98

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review Board (branch-1)

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: