Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11006

Allow overriding user limit factor and maxAMResourcePercent with AQCv2 templates

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      YARN-10801 fixed the template configurations for every queue property, but it introduced a strange behaviour as well. When setting the template configurations LeafQueue.setDynamicQueueProperties is called:

        @Override
        protected void setDynamicQueueProperties(
            CapacitySchedulerConfiguration configuration) {
          super.setDynamicQueueProperties(configuration);
          // set to -1, to disable it
          configuration.setUserLimitFactor(getQueuePath(), -1);
          // Set Max AM percentage to a higher value
          configuration.setMaximumApplicationMasterResourcePerQueuePercent(
              getQueuePath(), 1f);
        }
      

      This sets the configured template properties in the configuration object and then it overwrites the user limit factor and the maximum AM resource percent values with the hardcoded ones. The order should be reversed.

      Attachments

        Issue Links

          Activity

            People

              bteke Benjamin Teke
              bteke Benjamin Teke
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m