Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6891 Hadoop 2 unit test failures
  3. HBASE-8469

[hadoop2] Several tests break because of HDFS-4305

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.98.0, 0.94.6.1, 0.95.0
    • 0.98.0, 0.95.1
    • test
    • None
    • Reviewed

    Description

      Several unit tests will break due to HDFS-4305 (which enforces a min block size) because apprently, we set our block size smaller in these tests. 

      Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576
  at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:1816)
  at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:1795)
  at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:418)
  at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:205)
  at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44134)
  at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
  at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
  at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1696)
  at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1692)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Subject.java:396)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
  at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1690)

      org.apache.hadoop.hbase.regionserver.TestHRegion.testgetHDFSBlocksDistribution
      org.apache.hadoop.hbase.regionserver.TestHRegionBusyWait.testgetHDFSBlocksDistribution
      org.apache.hadoop.hbase.replication.TestMasterReplication.testCyclicReplication
      org.apache.hadoop.hbase.replication.TestMasterReplication.testSimplePutDelete
      org.apache.hadoop.hbase.replication.TestMultiSlaveReplication.testMultiSlaveReplication
      org.apache.hadoop.hbase.util.TestFSUtils.testcomputeHDFSBlocksDistribution

      Attachments

        1. hbase-8469.v3.patch
          1 kB
          Jonathan Hsieh
        2. hbase-8469.v2.patch
          0.6 kB
          Jonathan Hsieh
        3. hbase-8469.patch
          0.8 kB
          Jonathan Hsieh
        4. hbase-8469.94.patch
          0.8 kB
          Jonathan Hsieh

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. HBASE-8472 mvn -Dhadoop.profile=2.0 -Dhadoop-two.version=2.0.5-SNAPSHOT fails because of Undef Class error wrt o.a.h.IdGenerator

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HBASE-8478 HBASE-2231 breaks TestHRegion#testRecoveredEditsReplayCompaction under hadoop2 profile

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jmhsieh Jonathan Hsieh
              jmhsieh Jonathan Hsieh
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: