Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10830

Integration test MR jobs attempt to load htrace jars from the wrong location

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.98.1
    • 0.99.0, 0.98.2, 0.96.3
    • None
    • None
    • Reviewed

    Description

      The MapReduce jobs submitted by IntegrationTestImportTsv want to load the htrace JAR from the local Maven cache but get confused and use a HDFS URI.

      Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 8.489 sec <<< FAILURE!
      testGenerateAndLoad(org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv)  Time elapsed: 0.488 sec  <<< ERROR!
      java.io.FileNotFoundException: File does not exist: hdfs://localhost:37548/home/apurtell/.m2/repository/org/cloudera/htrace/htrace-core/2.04/htrace-core-2.04.jar
              at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1110)
              at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
              at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
              at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
              at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
              at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
              at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
              at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
              at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:264)
              at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:300)
              at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:387)
              at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
              at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:415)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
              at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
              at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
              at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:603)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.hadoop.hbase.mapreduce.TestImportTsv.doMROnTableTest(TestImportTsv.java:270)
              at org.apache.hadoop.hbase.mapreduce.TestImportTsv.doMROnTableTest(TestImportTsv.java:232)
              at org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.testGenerateAndLoad(IntegrationTestImportTsv.java:206)
      

      Attachments

        1. HBASE-10830.00.patch
          0.9 kB
          Nick Dimiduk
        2. HBASE-10830.01.patch
          3 kB
          Nick Dimiduk

        Activity

          People

            ndimiduk Nick Dimiduk
            apurtell Andrew Kyle Purtell
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: