Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-570

When opening a file for read, make the file length avaliable to client.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Append Branch
    • Append Branch
    • hdfs-client
    • None
    • Incompatible change, Reviewed
    • In order to support read consistency, get last block length from a data-node when opening a file being written to.

    Description

      In order to support read consistency, DFSClient needs the file length at the file opening time. In the current implmentation, DFSClient obtains the file length at the file opening time but the length is inaccurate if the file is being written.

      For more details, see Section 4 in the append design doc.

      Attachments

        1. h570_20090926.patch
          26 kB
          Konstantin Shvachko
        2. h570_20090926.patch
          26 kB
          Konstantin Shvachko
        3. h570_20090925c.patch
          27 kB
          Tsz-wo Sze
        4. h570_20090925b.patch
          25 kB
          Tsz-wo Sze
        5. h570_20090925.patch
          23 kB
          Tsz-wo Sze
        6. h570_20090924.patch
          17 kB
          Tsz-wo Sze
        7. h570_20090922.patch
          15 kB
          Tsz-wo Sze
        8. h570_20090828.patch
          25 kB
          Tsz-wo Sze

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-735 TestReadWhileWriting has wrong line termination symbols

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6307 Support reading on un-closed SequenceFile

          • Major - Major loss of function.
          • Closed

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: