Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-19954

Separate TestBlockReorder into individual tests to avoid ShutdownHook suppression error against hadoop3

    XMLWordPrintableJSON

Details

    • Reviewed
    • hadoop3 minidfscluster removes all shutdown handlers when the cluster goes down which made this test that does FS-stuff fail (Fix was to break up the test so each test method ran with an unadulterated FS).

    Description

      TestBlockReorder fails against hadoop 3 due to the following error:

      2018-02-08 17:22:23,389 ERROR [RS:0;cn012:38253] helpers.MarkerIgnoringBase(159): ***** ABORTING region server cn012.l42scl.hortonworks.com,38253,1518110542271: Unhandled: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6a0c707e *****
java.lang.RuntimeException: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6a0c707e
  at org.apache.hadoop.hbase.regionserver.ShutdownHook.suppressHdfsShutdownHook(ShutdownHook.java:207)
  at org.apache.hadoop.hbase.regionserver.ShutdownHook.install(ShutdownHook.java:85)
  at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:927)
  at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:187)

      This is because when MiniDFSCluster is stopped in first subtest, hadoop 3 clears ShutdownHook.
      When the 2nd test starts, suppression of ShutdownHook fails.

      Attachments

        1. 19954.v1.txt
          5 kB
          Ted Yu
        2. 19954.v2.txt
          6 kB
          Ted Yu
        3. 19954.v3.txt
          30 kB
          Ted Yu
        4. 19954.v4.txt
          32 kB
          Ted Yu

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HBASE-17921 TestBlockReorder always fails against hadoop3.0.0-alpha2

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HBASE-17922 TestRegionServerHostname always fails against hadoop 3.0.0-alpha2

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-7285 Erasure Coding Support inside HDFS

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HBASE-22444 Backport HBASE-19954 to branch-1

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              yuzhihong@gmail.com Ted Yu
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: