Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1489 [Umbrella] Work-preserving ApplicationMaster restart
  3. YARN-1041

Protocol changes for RM to bind and notify a restarted AM of existing containers

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.4.0
    • resourcemanager
    • None
    • Reviewed

    Description

      For long lived containers we don't want the AM to be a SPOF.

      When the RM restarts a (failed) AM, it should be given the list of containers it had already been allocated. the AM should then be able to contact the NMs to get details on them. NMs would also need to do any binding of the containers needed to handle a moved/restarted AM.

      Attachments

        1. YARN-1041.1.patch
          21 kB
          Jian He
        2. YARN-1041.2.patch
          29 kB
          Jian He
        3. YARN-1041.3.patch
          29 kB
          Jian He
        4. YARN-1041.4.patch
          29 kB
          Jian He
        5. YARN-1041.5.patch
          32 kB
          Jian He
        6. YARN-1041.6.patch
          32 kB
          Jian He
        7. YARN-1041.7.patch
          32 kB
          Jian He

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. YARN-896 Roll up for long-lived services in YARN

          • Major - Major loss of function.
          • Open
          breaks

          Test - A new unit, integration or system test. MAPREDUCE-5726 TestRMContainerAllocator#testCompletedTasksRecalculateSchedule fails

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-1588 Rebind NM tokens for previous attempt's running containers to the new attempt

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5743 TestRMContainerAllocator is failing

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jianhe Jian He
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: