Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8992

Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      As discovered in YARN-8990, QueueManager can see a leaf queue being empty while FSLeafQueue.addApp() is called in the middle of      

      return queue.getNumRunnableApps() == 0 &&
          leafQueue.getNumNonRunnableApps() == 0 &&
          leafQueue.getNumAssignedApps() == 0;

      Attachments

        1. YARN-8992.001.patch
          21 kB
          wilfreds#1
        2. YARN-8992.002.patch
          31 kB
          wilfreds#1

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-8990 Fix fair scheduler race condition in app submit and queue cleanup

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Web Link GitHub Pull Request #3257

          Activity

            People

              wilfreds Wilfred Spiegelenburg
              haibochen Haibo Chen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m