Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-16615

OIV: print out EC policy and EC replication in oiv Delimited output

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 3.0.0
    • 3.3.0
    • erasure-coding, tools
    • None

    Description

      Currently, the OIV tool does not support printing EC policy and EC replication of EC file. In addition, fsImage records only data blocks of EC files, ignoring parity blocks.
      We can calculate replication for EC files based on (data block + Parity Block)/(data block).

      For example, if we write 10K data to  file a.txt whose EC policy is RS-6-3-1 K, the file will consist of 10 data blocks and 6 parity block. So its replication factor is 1.6.

       

      Attachments

        1. HDFS-16615.001.patch
          22 kB
          kinit

        Activity

          People

            Unassigned Unassigned
            mofei kinit
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: