Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-8668

Erasure Coding: revisit buffer used for encoding and decoding.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      For encoding and decoding buffers, currently some places use java heap ByteBuffer, some use direct byteBUffer, and some use java byte array. If the coder implementation is native, we should use direct ByteBuffer. This jira is to revisit all encoding/decoding buffers and improve them.

      Attachments

        1. HDFS-8668-v9.patch
          27 kB
          Sammi Chen
        2. HDFS-8668-v8.patch
          27 kB
          Sammi Chen
        3. HDFS-8668-v7.patch
          26 kB
          Sammi Chen
        4. HDFS-8668-v6.patch
          18 kB
          Sammi Chen
        5. HDFS-8668-v5.patch
          17 kB
          Sammi Chen
        6. HDFS-8668-v4.patch
          16 kB
          Sammi Chen
        7. HDFS-8668-v3.patch
          14 kB
          Sammi Chen
        8. HDFS-8668-v2.patch
          15 kB
          Kai Zheng
        9. HDFS-8668-v1.patch
          14 kB
          Kai Zheng

        Issue Links

          contains

          Sub-task - The sub-task of the issue HDFS-8901 Use ByteBuffer in striping positional read

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8902 Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8903 Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping write

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8904 Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping recovery on DataNode side

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HDFS-10718 Prefer direct ByteBuffer in native RS encoder and decoder

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Sammi Sammi Chen
              hitliuyi Yi Liu
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: