Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • test
    • None

    Description

      It killed a nightly. Failed in flakey suite. The compare is too sensitive to slightest variance. Here are two failiures... one because the previous test had not finished putting back a Region that had been offlined, and the other because the count of requests was off slightly. Let me make the compare coarser....

      Test set: org.apache.hadoop.hbase.TestClientClusterStatus
      -------------------------------------------------------------------------------
      Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 27.858 s <<< FAILURE! - in org.apache.hadoop.hbase.TestClientClusterStatus
      testNone(org.apache.hadoop.hbase.TestClientClusterStatus)  Time elapsed: 0.236 s  <<< FAILURE!
      java.lang.AssertionError: 
      expected:<Master: asf903.gq1.ygridcore.net,45687,1519246533030
      Number of backup masters: 2
        asf903.gq1.ygridcore.net,34661,1519246530655
        asf903.gq1.ygridcore.net,34734,1519246533133
      Number of live region servers: 4
        asf903.gq1.ygridcore.net,37432,1519246533632
        asf903.gq1.ygridcore.net,42964,1519246533554
        asf903.gq1.ygridcore.net,43699,1519246533376
        asf903.gq1.ygridcore.net,56911,1519246533711
      Number of dead region servers: 1
        asf903.gq1.ygridcore.net,57278,1519246533770
      Average load: 0.25
      Number of requests: 17
      Number of regions: 1
      Number of regions in transition: 0> but was:<Master: asf903.gq1.ygridcore.net,45687,1519246533030
      Number of backup masters: 2
        asf903.gq1.ygridcore.net,34661,1519246530655
        asf903.gq1.ygridcore.net,34734,1519246533133
      Number of live region servers: 4
        asf903.gq1.ygridcore.net,37432,1519246533632
        asf903.gq1.ygridcore.net,42964,1519246533554
        asf903.gq1.ygridcore.net,43699,1519246533376
        asf903.gq1.ygridcore.net,56911,1519246533711
      Number of dead region servers: 1
        asf903.gq1.ygridcore.net,57278,1519246533770
      Average load: 0.5
      Number of requests: 17
      Number of regions: 2
      Number of regions in transition: 0>
      	at org.apache.hadoop.hbase.TestClientClusterStatus.testNone(TestClientClusterStatus.java:107)
      

      and

      [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.416 s <<< FAILURE! - in org.apache.hadoop.hbase.TestClientClusterStatus
      [ERROR] testNone(org.apache.hadoop.hbase.TestClientClusterStatus)  Time elapsed: 0.065 s  <<< FAILURE!
      java.lang.AssertionError: 
      expected:<Master: 9845c79afe69,46509,1519227084385
      Number of backup masters: 2
        9845c79afe69,35076,1519227086213
        9845c79afe69,45963,1519227086363
      Number of live region servers: 4
        9845c79afe69,34709,1519227086571
        9845c79afe69,34961,1519227086645
        9845c79afe69,35891,1519227086720
        9845c79afe69,36139,1519227086486
      Number of dead region servers: 1
        9845c79afe69,41992,1519227086820
      Average load: 0.5
      Number of requests: 17
      Number of regions: 2
      Number of regions in transition: 0> but was:<Master: 9845c79afe69,46509,1519227084385
      Number of backup masters: 2
        9845c79afe69,35076,1519227086213
        9845c79afe69,45963,1519227086363
      Number of live region servers: 4
        9845c79afe69,34709,1519227086571
        9845c79afe69,34961,1519227086645
        9845c79afe69,35891,1519227086720
        9845c79afe69,36139,1519227086486
      Number of dead region servers: 1
        9845c79afe69,41992,1519227086820
      Average load: 0.5
      Number of requests: 19
      Number of regions: 2
      Number of regions in transition: 0>
      	at org.apache.hadoop.hbase.TestClientClusterStatus.testNone(TestClientClusterStatus.java:107)
      

      Attachments

        1. HBASE-20044.branch-2.001.patch
          2 kB
          Michael Stack

        Issue Links

          Activity

            stack Michael Stack added a comment -

            .001 is what I pushed to master and branch-2. Keeping open to see if this helps.

            stack Michael Stack added a comment - .001 is what I pushed to master and branch-2. Keeping open to see if this helps.
            chia7712 Chia-Ping Tsai added a comment -

            +1

            chia7712 Chia-Ping Tsai added a comment - +1
            zhangduo Duo Zhang added a comment -
            commit 3a3994223c5d634bdd7ef01ef7f31ff860849575
            Author: Michael Stack <stack@apache.org>
            Date:   Wed Feb 21 14:52:10 2018 -0800
            
                HBASE-2004 TestClientClusterStatus is flakey
            

            Should be HBASE-20044?

            zhangduo Duo Zhang added a comment - commit 3a3994223c5d634bdd7ef01ef7f31ff860849575 Author: Michael Stack <stack@apache.org> Date: Wed Feb 21 14:52:10 2018 -0800 HBASE-2004 TestClientClusterStatus is flakey Should be HBASE-20044 ?
            stack Michael Stack added a comment -

            @duo zhang Thanks... reverted and reapplied with correct JIRA number.

            stack Michael Stack added a comment - @duo zhang Thanks... reverted and reapplied with correct JIRA number.
            stack Michael Stack added a comment -

            Resolving. No longer on flakies list.

            stack Michael Stack added a comment - Resolving. No longer on flakies list.
            hudson Hudson added a comment -

            FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4632 (See https://builds.apache.org/job/HBase-Trunk_matrix/4632/)
            HBASE-20044 TestClientClusterStatus is flakey" Revert "Revert (stack: rev 3434e99e6c728d59ba99141df3730f3e70e0059c)

            • (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestClientClusterStatus.java
            hudson Hudson added a comment - FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4632 (See https://builds.apache.org/job/HBase-Trunk_matrix/4632/ ) HBASE-20044 TestClientClusterStatus is flakey" Revert "Revert (stack: rev 3434e99e6c728d59ba99141df3730f3e70e0059c) (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestClientClusterStatus.java

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: