Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13638

DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • datanode
    • None

    Description

      I occasionally find the following warning in CDH clusters, but haven't figured out why. Thought I should better raise the issue anyway.

      2018-05-29 09:15:58,092 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Can't replicate block BP-725378529-10.0.0.8-1410027444173:blk_13276745777_1112363330268 because on-disk length 175085 is shorter than NameNode recorded length 9223372036854775807

      Infact, 9223372036854775807 = Long.MAX_VALUE.

      Chasing in the HDFS codebase but didn't find where this length could come from

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HDFS-14720 DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10453 ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-13663 Should throw exception when incorrect block size is set

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              weichiu Wei-Chiu Chuang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: