Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5597 YARN Federation improvements
  3. YARN-10201

Make AMRMProxyPolicy aware of SC load

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • amrmproxy
    • None
    • Reviewed

    Description

      LocalityMulticastAMRMProxyPolicy is currently unaware of SC load when splitting resource requests. We propose changes to the policy so that it receives feedback from SCs and can load balance requests across the federated cluster.

      Attachments

        1. YARN-10201.v9.patch
          67 kB
          Young Chen
        2. YARN-10201.v8.patch
          72 kB
          Young Chen
        3. YARN-10201.v7.patch
          73 kB
          Young Chen
        4. YARN-10201.v6.patch
          80 kB
          Young Chen
        5. YARN-10201.v5.patch
          75 kB
          Young Chen
        6. YARN-10201.v4.patch
          74 kB
          Young Chen
        7. YARN-10201.v3.patch
          75 kB
          Young Chen
        8. YARN-10201.v2.patch
          75 kB
          Young Chen
        9. YARN-10201.v10.patch
          66 kB
          Young Chen
        10. YARN-10201.v1.patch
          75 kB
          Young Chen
        11. YARN-10201.v0.patch
          20 kB
          Young Chen

        Issue Links

          is a parent of

          Sub-task - The sub-task of the issue YARN-11034 Add enhanced headroom in AllocateResponse

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. YARN-11037 Add configurable logic to split resource request to least loaded SC

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-10174 Add colored policies to enable manual load balancing across sub clusters

          • Major - Major loss of function.
          • Open

          Activity

            People

              slfan1989 Shilun Fan
              youchen Young Chen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: