Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5892

Support user-specific minimum user limit percentage in Capacity Scheduler

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Currently, in the capacity scheduler, the minimum-user-limit-percent property is per queue. A cluster admin should be able to set the minimum user limit percent on a per-user basis within the queue.

      This functionality is needed so that when intra-queue preemption is enabled (YARN-4945 / YARN-2113), some users can be deemed as more important than other users, and resources from VIP users won't be as likely to be preempted.

      For example, if the getstuffdone queue has a MULP of 25 percent, but user jane is a power user of queue getstuffdone and needs to be guaranteed 75 percent, the properties for getstuffdone and jane would look like this:

        <property>
          <name>yarn.scheduler.capacity.root.getstuffdone.minimum-user-limit-percent</name>
          <value>25</value>
        </property>
      
        <property>
          <name>yarn.scheduler.capacity.root.getstuffdone.jane.minimum-user-limit-percent</name>
          <value>75</value>
        </property>
      

      Attachments

        1. YARN-5892.branch-2.8.018.patch
          39 kB
          Eric Payne
        2. YARN-5892.branch-2.8.017.patch
          39 kB
          Eric Payne
        3. YARN-5892.branch-2.8.016.patch
          39 kB
          Eric Payne
        4. YARN-5892.branch-2.016.patch
          42 kB
          Eric Payne
        5. YARN-5892.branch-2.015.patch
          38 kB
          Eric Payne
        6. YARN-5892.015.patch
          42 kB
          Eric Payne
        7. YARN-5892.014.patch
          43 kB
          Eric Payne
        8. YARN-5892.013.patch
          45 kB
          Eric Payne
        9. YARN-5892.012.patch
          45 kB
          Eric Payne
        10. YARN-5892.010.patch
          45 kB
          Eric Payne
        11. YARN-5892.009.patch
          36 kB
          Eric Payne
        12. YARN-5892.008.patch
          36 kB
          Eric Payne
        13. YARN-5892.007.patch
          36 kB
          Eric Payne
        14. YARN-5892.006.patch
          30 kB
          Eric Payne
        15. YARN-5892.005.patch
          42 kB
          Eric Payne
        16. YARN-5892.004.patch
          40 kB
          Eric Payne
        17. YARN-5892.003.patch
          38 kB
          Eric Payne
        18. YARN-5892.002.patch
          34 kB
          Eric Payne
        19. YARN-5892.001.patch
          34 kB
          Eric Payne
        20. Active users highlighted.jpg
          485 kB
          Eric Payne

        Issue Links

          Activity

            People

              epayne Eric Payne
              epayne Eric Payne
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: