Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-556 [Umbrella] RM Restart phase 2 - Work preserving restart
  3. YARN-2567

Add a percentage-node threshold for RM to wait for new allocations after restart/failover

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • resourcemanager
    • None

    Description

      This is the remaining part of YARN-2001 - to halt allocations after restart till x% of nodes sync back with the RM. This is useful for avoiding bad scheduling during the time the nodes are still joining back after a restart/failover.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4679 When work-preserving restart is enabled, the scheduler should wait for the earlier of recovery completion and configured wait time

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-2047 RM should honor NM heartbeat expiry after RM restart

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue YARN-2001 Threshold for RM to accept requests from AM after failover

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. YARN-1071 ResourceManager's decommissioned and lost node count is 0 after restart

          • Major - Major loss of function.
          • Closed

          Activity

            People

              vinodkv Vinod Kumar Vavilapalli
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated: