Details
-
Bug
-
Status: Reopened
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Three runs in a row have failed with ReplicatedPutAllBenchmark average latency is 5% worse than baseline starting with:
e.g.
org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark average ops/second Baseline: 900.64 Test: 828.40 Difference: -8.0% ops/second standard error Baseline: 2.71 Test: 2.47 Difference: -8.9% ops/second standard deviation Baseline: 46.91 Test: 42.76 Difference: -8.9% YS 99th percentile latency Baseline: 20099.00 Test: 20099.00 Difference: +0.0% median latency Baseline: 158728191.00 Test: 172359679.00 Difference: +8.6% 90th percentile latency Baseline: 228458495.00 Test: 244449279.00 Difference: +7.0% 99th percentile latency Baseline: 299368447.00 Test: 319815679.00 Difference: +6.8% 99.9th percentile latency Baseline: 354156543.00 Test: 387710975.00 Difference: +9.5% average latency Baseline: 160197744.39 Test: 174083983.05 Difference: +8.7% latency standard deviation Baseline: 53484962.25 Test: 55775317.05 Difference: +4.3% latency standard error Baseline: 103053.88 Test: 111997.05 Difference: +8.7%