Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15475 Fix broken unit tests on Windows
  3. HADOOP-15454

TestRollingFileSystemSinkWithLocal fails on Windows

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal fails on Windows,

      Error message:

      Illegal character in opaque part at index 2: D:_work\8\s\hadoop-common-project\hadoop-common\target\test\data\4\RollingFileSystemSinkTest\testSilentExistingWrite

      Stack trace:

      java.io.IOException: All datanodes [DatanodeInfoWithStorage[127.0.0.1:53235,DS-4d6119ac-31cc-4f48-8a5b-7f35b36a1c55,DISK]] are bad. Aborting... at org.apache.hadoop.hdfs.DataStreamer.handleBadDatanode(DataStreamer.java:1538) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1472) at org.apache.hadoop.hdfs.DataStreamer.processDatanodeError(DataStreamer.java:1244) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:663)

      Drive letter in absolute path in Windows will fail the underlying URI check.

      Another issue is that for the failed write test case java.io.File#setWritable(boolean, boolean) is used, which does not work as expected on Windows and should be replaced by org.apache.hadoop.fs.FileUtil#setWritable.

      Attachments

        1. HADOOP-15454.000.patch
          3 kB
          Xiao Liang
        2. HADOOP-15454-branch-2.000.patch
          3 kB
          Xiao Liang

        Issue Links

          Activity

            People

              surmountian Xiao Liang
              surmountian Xiao Liang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: