Uploaded image for project: 'Geode'
  1. Geode
  2. GEODE-7616

ReplicatedPutAllBenchmark average latency is 5% worse than baseline

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • None
    • None
    • benchmarks
    • None

    Description

      Three runs in a row have failed with ReplicatedPutAllBenchmark average latency is 5% worse than baseline starting with:

      https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/23

      e.g.

      org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark
      
                    average ops/second  Baseline:       900.64  Test:       828.40  Difference:   -8.0%
      
             ops/second standard error  Baseline:         2.71  Test:         2.47  Difference:   -8.9%
      
         ops/second standard deviation  Baseline:        46.91  Test:        42.76  Difference:   -8.9%
      
            YS 99th percentile latency  Baseline:     20099.00  Test:     20099.00  Difference:   +0.0%
      
                        median latency  Baseline: 158728191.00  Test: 172359679.00  Difference:   +8.6%
      
               90th percentile latency  Baseline: 228458495.00  Test: 244449279.00  Difference:   +7.0%
      
               99th percentile latency  Baseline: 299368447.00  Test: 319815679.00  Difference:   +6.8%
      
             99.9th percentile latency  Baseline: 354156543.00  Test: 387710975.00  Difference:   +9.5%
      
                       average latency  Baseline: 160197744.39  Test: 174083983.05  Difference:   +8.7%
      
            latency standard deviation  Baseline:  53484962.25  Test:  55775317.05  Difference:   +4.3%
      
                latency standard error  Baseline:    103053.88  Test:    111997.05  Difference:   +8.7%
      

      Attachments

        Activity

          People

            jbarrett Jacob Barrett
            burcham Bill Burcham
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: