Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8896

Limit the maximum number of container assignments per heartbeat

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.9.0, 3.0.0
    • 2.10.0, 3.0.4, 3.1.2, 3.2.1
    • None
    • None

    Description

      YARN-4161 adds a configuration yarn.scheduler.capacity.per-node-heartbeat.maximum-container-assignments to control max number of container assignments per heartbeat, however the default value is -1. This could potentially cause the CS gets stuck in the while loop causing issue like YARN-8513. We should change this to a finite number, e.g 100.

      Attachments

        1. YARN-8896-trunk.001.patch
          1 kB
          Zhankun Tang

        Issue Links

          breaks

          Test - A new unit, integration or system test. YARN-8944 TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          causes

          Bug - A problem which impairs or prevents the functions of the product. YARN-8513 CapacityScheduler infinite loop when queue is near fully utilized

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. YARN-10440 resource manager hangs,and i cannot submit any new jobs,but rm and nm processes are normal

          • Blocker - Blocks development and/or testing work, production could not run
          • Reopened
          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-8513 CapacityScheduler infinite loop when queue is near fully utilized

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-8915 Update the doc about the default value of "maximum-container-assignments" for capacity scheduler

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              tangzhankun Zhankun Tang
              cheersyang Weiwei Yang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: