Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15359

EC: Allow closing a file with committed blocks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • erasure-coding
    • None
    • Reviewed

    Description

      Presently, dfs.namenode.file.close.num-committed-allowed is ignored in case of EC blocks. But in case of heavy loads, IBR's from Datanode may get delayed and cause the file write to fail. So, can allow EC files to close with blocks in committed state as REP files

      Attachments

        1. HDFS-15359-05.patch
          8 kB
          Ayush Saxena
        2. HDFS-15359-04.patch
          7 kB
          Ayush Saxena
        3. HDFS-15359-03.patch
          5 kB
          Ayush Saxena
        4. HDFS-15359-02.patch
          3 kB
          Ayush Saxena
        5. HDFS-15359-01.patch
          5 kB
          Ayush Saxena

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15315 IOException on close() when using Erasure Coding

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8999 Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8999 Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ayushtkn Ayush Saxena
              ayushtkn Ayush Saxena
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: