Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19273

S3A: Commiter ITests failing unless job.id set

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.5.0, 3.4.1
    • None
    • fs/s3, test
    • None

    Description

      the job.id maven setup is broken on parallel runs: unless explicitly set on the command line tests which try to parse its traling bits as a number will fail.

      [ERROR] testBinding[File committer in task-fs=[]-task=[file]-[class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter]](org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory)  Time elapsed: 0.181 s  <<< ERROR!
java.lang.Exception: Failed to parse b-00

      Emergency workaround: set it

      -Djob.id=0001

      Attachments

        Issue Links

          is caused by

          Sub-task - The sub-task of the issue HADOOP-18508 support multiple s3a integration test runs on same bucket in parallel

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: