Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-556 [Umbrella] RM Restart phase 2 - Work preserving restart
  3. YARN-2052

ContainerId creation after work preserving restart is broken

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • resourcemanager
    • None
    • Reviewed

    Description

      Container ids are made unique by using the app identifier and appending a monotonically increasing sequence number to it. Since container creation is a high churn activity the RM does not store the sequence number per app. So after restart it does not know what the new sequence number should be for new allocations.

      Attachments

        1. YARN-2052.9.patch
          37 kB
          Tsuyoshi Ozawa
        2. YARN-2052.9.patch
          37 kB
          Tsuyoshi Ozawa
        3. YARN-2052.8.patch
          37 kB
          Tsuyoshi Ozawa
        4. YARN-2052.7.patch
          45 kB
          Tsuyoshi Ozawa
        5. YARN-2052.6.patch
          36 kB
          Tsuyoshi Ozawa
        6. YARN-2052.5.patch
          35 kB
          Tsuyoshi Ozawa
        7. YARN-2052.4.patch
          4 kB
          Tsuyoshi Ozawa
        8. YARN-2052.3.patch
          7 kB
          Tsuyoshi Ozawa
        9. YARN-2052.2.patch
          6 kB
          Tsuyoshi Ozawa
        10. YARN-2052.12.patch
          38 kB
          Tsuyoshi Ozawa
        11. YARN-2052.11.patch
          38 kB
          Tsuyoshi Ozawa
        12. YARN-2052.10.patch
          37 kB
          Tsuyoshi Ozawa
        13. YARN-2052.1.patch
          5 kB
          Tsuyoshi Ozawa

        Issue Links

          relates to

          Sub-task - The sub-task of the issue YARN-2182 Update ContainerId#toString() to avoid conflicts before and after RM restart

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-2229 ContainerId can overflow with RM restart

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ozawa Tsuyoshi Ozawa
              ozawa Tsuyoshi Ozawa
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: