Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9858

Optimize RMContext getExclusiveEnforcedPartitions

    XMLWordPrintableJSON

Details

    Description

      Follow-up from YARN-9730. RMContextImpl#getExclusiveEnforcedPartitions is a hot code path, need to optimize it .

      Since AMS allocate invoked by multiple handlers locking on conf will occur

      java.lang.Thread.State: BLOCKED (on object monitor)
 at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2841)
 - waiting to lock <0x00007f1f8107c748> (a org.apache.hadoop.yarn.conf.YarnConfiguration)
 at org.apache.hadoop.conf.Configuration.get(Configuration.java:1214)
 at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1268)

      Attachments

        1. YARN-9858.001.patch
          2 kB
          Jonathan Hung
        2. YARN-9858.002.patch
          8 kB
          Jonathan Hung
        3. YARN-9858.003.patch
          8 kB
          Jonathan Hung
        4. YARN-9858-branch-2.001.patch
          9 kB
          Jonathan Hung
        5. YARN-9858-branch-3.1.001.patch
          9 kB
          Jonathan Hung
        6. YARN-9858-branch-3.2.001.patch
          8 kB
          Jonathan Hung

        Issue Links

          relates to

          Task - A task that needs to be done. YARN-9730 Support forcing configured partitions to be exclusive based on app node label

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jhung Jonathan Hung
              jhung Jonathan Hung
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: