Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7197 Enhancements to Mover
  3. HDFS-7310

Mover can give first priority to local DN if it has target storage type available in local DN

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.7.0
    • balancer & mover
    • None
    • Reviewed

    Description

      Currently Mover logic may move blocks to any DN which had target storage type. But if the src DN has target storage type then mover can give highest priority to local DN. If local DN does not contains target storage type, then it can assign to any DN as the current logic does.
      This is a thought, have not go through the code fully yet.

      Thoughts?

      Attachments

        1. HDFS-7310-004.patch
          45 kB
          Vinayakumar B
        2. HDFS-7310-003.patch
          44 kB
          Vinayakumar B
        3. HDFS-7310-002.patch
          35 kB
          Vinayakumar B
        4. HDFS-7310-001.patch
          27 kB
          Vinayakumar B

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8147 Mover should not schedule two replicas to the same DN storage

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-8204 Mover/Balancer should not schedule two replicas to the same DN

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-9661 Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

          • Major - Major loss of function.
          • Closed

          Activity

            People

              vinayakumarb Vinayakumar B
              umamaheswararao Uma Maheswara Rao G
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: