Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1120

Make DataNode's block-to-device placement policy pluggable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.23.0
    • datanode
    • None
    • Reviewed
    • Make the DataNode's block-volume choosing policy pluggable.
    • datanode, volumes, policy

    Description

      As discussed on the mailing list, as the number of disk drives per server increases, it would be useful to allow the DataNode's policy for new block placement to grow in sophistication from the current round-robin strategy.

      Attachments

        1. HDFS-1120.r4.diff
          12 kB
          Harsh J
        2. HDFS-1120.r3.diff
          12 kB
          Harsh J
        3. HDFS-1120.r2.diff
          13 kB
          Harsh J
        4. HDFS-1120.r1.diff
          12 kB
          Harsh J

        Issue Links

          incorporates

          Bug - A problem which impairs or prevents the functions of the product. HDFS-1797 New findbugs warning introduced by HDFS-1120

          • Major - Major loss of function.
          • Closed
          is related to

          Sub-task - The sub-task of the issue HDFS-2887 Define a FSVolume interface

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-1804 Add a new block-volume device choosing policy that looks at free space

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1121 Allow HDFS client to measure distribution of blocks across devices for a specific DataNode

          • Major - Major loss of function.
          • Open
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-1312 Re-balance disks within a Datanode

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              qwertymaniac Harsh J
              hammer Jeff Hammerbacher
              Votes:
              4 Vote for this issue
              Watchers:
              25 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: