Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1060 Append/flush should support concurrent "tailer" use case
  3. HDFS-1058

reading from file under construction fails if it reader beats writer to DN for new block

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.21.0, 0.22.0
    • None
    • datanode, hdfs-client
    • None

    Description

      If there is a writer and concurrent reader, the following can occur:

      • The writer allocates a new block from the NN
      • The reader calls getBlockLocations
      • Reader connects to the DN and calls getReplicaVisibleLength
      • writer still has not talked to the DN, so DN doesn't know about the block and throws an error

      Attachments

        Activity

          People

            Unassigned Unassigned
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated: