Uploaded image for project: 'Geode'
  1. Geode
  2. GEODE-9847

Benchmark instability in PartitionedPutLongBenchmark with security manager on support/1.14

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.14.1
    • None
    • benchmarks
    • None

    Description

      PartitionedPutLongBenchmark failed in apache-support-1-14-main/benchmark-with-security-manager. This issue could have the same root cause as GEODE-9340, but GEODE-9340 fails on 1.15 and in another CI job (apache-develop-main/benchmark-base).

      org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark
      05:20:08              average ops/second  Baseline:    381785.31  Test:    351135.20  Difference:   -8.0%
      05:20:08       ops/second standard error  Baseline:      2163.90  Test:      3115.81  Difference:  +44.0%
      05:20:08   ops/second standard deviation  Baseline:     37417.40  Test:     53877.38  Difference:  +44.0%
      05:20:08      YS 99th percentile latency  Baseline:      1606.00  Test:      1606.00  Difference:   +0.0%
      05:20:08                  median latency  Baseline:   1068031.00  Test:   1065983.00  Difference:   -0.2%
      05:20:08         90th percentile latency  Baseline:   1364991.00  Test:   1356799.00  Difference:   -0.6%
      05:20:08         99th percentile latency  Baseline:   7688191.00  Test:   8138751.00  Difference:   +5.9%
      05:20:08       99.9th percentile latency  Baseline: 209584127.00  Test: 260964351.00  Difference:  +24.5%
      05:20:08                 average latency  Baseline:   1884576.09  Test:   2050262.70  Difference:   +8.8%
      05:20:08      latency standard deviation  Baseline:  11587055.57  Test:  14728140.58  Difference:  +27.1%
      05:20:08          latency standard error  Baseline:      1083.17  Test:      1435.92  Difference:  +32.6%
      05:20:08              average ops/second  Baseline:    381621.08  Test:    350789.84  Difference:   -8.1%
      05:20:08BENCHMARK FAILED: org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark average latency is 5% worse than baseline.
      05:20:08

      Attachments

        Issue Links

          Activity

            People

              kaslami Kamilla Aslami
              kaslami Kamilla Aslami
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: