Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13542

TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.2
    • 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
    • None
    • Reviewed

    Description

      branch-2.9 has failure message on Windows:

      2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. Permissions dump:
      path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
       permissions: drwx
      path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
       permissions: drwx
      path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
       permissions: drwx
      path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
       permissions: drwx
      path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
       permissions: drwx
      path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
       permissions: drwx
      path 'E:\OSSHadoop\hadoop-hdfs-project': 
       absolute:E:\OSSHadoop\hadoop-hdfs-project
       permissions: drwx
      path 'E:\OSSHadoop': 
       absolute:E:\OSSHadoop
       permissions: drwx
      path 'E:\': 
       absolute:E:\
       permissions: drwxjava.io.IOException: Could not fully delete E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
       at org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
       at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
       at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
       at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:515)
       at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
       at org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465)

      Attachments

        1. HDFS-13542.000.patch
          9 kB
          Anbang Hu
        2. HDFS-13542.001.patch
          9 kB
          Anbang Hu
        3. HDFS-13542-branch-2.000.patch
          9 kB
          Anbang Hu
        4. HDFS-13542-branch-2.001.patch
          9 kB
          Anbang Hu

        Issue Links

          Activity

            People

              huanbang1993 Anbang Hu
              huanbang1993 Anbang Hu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: