Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0-beta-2, 2.0.0
    • None
    • None
    • Reviewed
    • Ups the overall test timeout from 10 minutes to 13minutes. 15minutes is the surefire timeout.

    Description

      TestAdmin1 has 28+ tests. Nightly #336 shows this:

      [ERROR] Tests run: 27, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 575.102 s <<< FAILURE! - in org.apache.hadoop.hbase.client.TestAdmin1
      [ERROR] org.apache.hadoop.hbase.client.TestAdmin1  Time elapsed: 1.134 s  <<< ERROR!
      org.junit.runners.model.TestTimedOutException: test timed out after 600 seconds
      	at org.apache.hadoop.hbase.client.TestAdmin1.testTableExist(TestAdmin1.java:899)
      
      [ERROR] testTableExist(org.apache.hadoop.hbase.client.TestAdmin1)  Time elapsed: 1.134 s  <<< ERROR!
      java.io.InterruptedIOException: Interrupt while waiting on Operation: CREATE, Table Name: default:testTableExist
      	at org.apache.hadoop.hbase.client.TestAdmin1.testTableExist(TestAdmin1.java:899)
      
      [ERROR] org.apache.hadoop.hbase.client.TestAdmin1  Time elapsed: 0.022 s  <<< ERROR!
      java.lang.Exception: Appears to be stuck in thread RS-EventLoopGroup-5-4
      
      [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 576.783 s <<< FAILURE! - in org.apache.hadoop.hbase.client.TestAdmin1
      [ERROR] org.apache.hadoop.hbase.client.TestAdmin1  Time elapsed: 1.704 s  <<< ERROR!
      java.lang.IllegalStateException: A mini-cluster is already running
      	at org.apache.hadoop.hbase.client.TestAdmin1.setUpBeforeClass(TestAdmin1.java:97)
      

      So, we timeout after running a test for only 1.3 seconds... but in total it is > 600.

      Then we are on to interesting stuff like minicluster running already. I've seen this in past.

      I could refactor TestAdmin1... let me up the general timeout instead....

      Attachments

        1. HBASE-20014.branch-2.001.patch
          2 kB
          Michael Stack

        Issue Links

          Activity

            stack Michael Stack added a comment -

            .001 Pushed to master and branch-2.

            Leaving open to see if fixes this one.

            stack Michael Stack added a comment - .001 Pushed to master and branch-2. Leaving open to see if fixes this one.
            hudson Hudson added a comment -

            FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4599 (See https://builds.apache.org/job/HBase-Trunk_matrix/4599/)
            HBASE-20014 TestAdmin1 Times out (stack: rev 969895105c77aaa34f4678d1924e83ebda7edb0f)

            • (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/HBaseClassTestRule.java
            • (edit) src/main/asciidoc/_chapters/developer.adoc
            hudson Hudson added a comment - FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4599 (See https://builds.apache.org/job/HBase-Trunk_matrix/4599/ ) HBASE-20014 TestAdmin1 Times out (stack: rev 969895105c77aaa34f4678d1924e83ebda7edb0f) (edit) hbase-common/src/test/java/org/apache/hadoop/hbase/HBaseClassTestRule.java (edit) src/main/asciidoc/_chapters/developer.adoc
            zhangduo Duo Zhang added a comment -

            Let me try splitting it to several small ones.

            zhangduo Duo Zhang added a comment - Let me try splitting it to several small ones.
            zhangduo Duo Zhang added a comment -

            It only runs about 130 seconds for me locally so I think it is OK to keep them in one class. Why it takes more than 600 seconds to finish in a nightly build? It is about 5 times more...

            Thanks.

            zhangduo Duo Zhang added a comment - It only runs about 130 seconds for me locally so I think it is OK to keep them in one class. Why it takes more than 600 seconds to finish in a nightly build? It is about 5 times more... Thanks.
            stack Michael Stack added a comment -

            It only runs about 130 seconds for me locally so I think it is OK to keep them in one class. Why it takes more than 600 seconds to finish in a nightly build? It is about 5 times more...

            Not sure. When I look at the the nightly test runs, the overall time seems to vary wildly. Need to look. Here a successful unit test against hadoop 2 takes 4h 20min: https://builds.apache.org/job/HBase%20Nightly/job/branch-2/350/ The build just before it was successful too but it took 2h 53min.

            stack Michael Stack added a comment - It only runs about 130 seconds for me locally so I think it is OK to keep them in one class. Why it takes more than 600 seconds to finish in a nightly build? It is about 5 times more... Not sure. When I look at the the nightly test runs, the overall time seems to vary wildly. Need to look. Here a successful unit test against hadoop 2 takes 4h 20min: https://builds.apache.org/job/HBase%20Nightly/job/branch-2/350/ The build just before it was successful too but it took 2h 53min.
            stack Michael Stack added a comment -

            Resolving. It has fallen off the flakies list.

            stack Michael Stack added a comment - Resolving. It has fallen off the flakies list.

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: