Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11174

Setting user limit factor on dynamic queues at runtime does not propagate to ConfigurationProperties

    XMLWordPrintableJSON

Details

    Description

      YARN-10838 introduced a ConfigurationProperties class, that is optimised for fast prefixed retrievals. However, changes at runtime on a CSConfig object will not have effect on this cache. The only way to propagate those changes is to reinitialise the entire cache, which could be costly. 

      In order to avoid unnecessary operations, we need a way to add new entries to the ConfigurationProperties in constant time.

      In addition to this, YARN-11006 implemented a way for dynamic queues to be able to override user limit factors via templates. However, this only worked because of the missing propagations, hence it is a bug in the logic that should be fixed.

      Attachments

        Issue Links

          Activity

            People

              quapaw András Győri
              quapaw András Győri
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h