Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-517

Introduce BlockInfoUnderConstruction to reflect block replica states while writing.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.21.0
    • Append Branch
    • namenode
    • None
    • Reviewed

    Description

      Currently when a block is created its locations are stored in INodeFileUnderConstruction.targets, which correspond to the last allocated block. With the new append design we will need to keep track of block replicas for several blocks rather than just the last one.

      Attachments

        1. Append-UCBlock.patch
          47 kB
          Konstantin Shvachko
        2. Append-UCBlock.patch
          25 kB
          Konstantin Shvachko
        3. Append-UCBlock.patch
          25 kB
          Konstantin Shvachko
        4. Append-UCBlock-h265.patch
          48 kB
          Konstantin Shvachko
        5. Append-UCBlock-h265.patch
          48 kB
          Konstantin Shvachko

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-529 More redundant block searches in BlockManager.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-546 DatanodeDescriptor block iterator should be BlockInfo based rather than Block.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              shv Konstantin Shvachko
              shv Konstantin Shvachko
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: