Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4208

NameNode could be stuck in SafeMode due to never-created blocks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.1.0
    • 1.1.2
    • namenode
    • None
    • Reviewed

    Description

      In one test case, NameNode allocated a block and then was killed before the client got the addBlock response. After NameNode restarted, it couldn't get out of SafeMode waiting for the block which was never created. In trunk, NameNode can get out of SafeMode since it only counts complete blocks. However branch-1 doesn't have the clear notion of under-constructioned-block in Namenode.

      JIRA HDFS-4212 is to track the never-created-block issue and this JIRA is to fix NameNode in branch-1 so it can get out of SafeMode when never-created-block exists.

      The proposed idea is for SafeMode not to count the zero-sized last block in an under-construction file as part of total blcok count.

      Attachments

        1. HDFS-4208.branch-1.patch
          6 kB
          Brandon Li
        2. HDFS-4208.branch-1.patch
          5 kB
          Brandon Li
        3. HDFS-4208.branch-1.patch
          4 kB
          Brandon Li

        Issue Links

          Activity

            People

              brandonli Brandon Li
              brandonli Brandon Li
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: