Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1321

NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • client
    • None
    • Reviewed

    Description

      NMTokenCache is a singleton. Because of this, if running multiple AMs in a single JVM NMTokens for the same node from different AMs step on each other and starting containers fail due to mismatch tokens.

      The error observed in the client side is something like:

      ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:llama (auth:PROXY) via llama (auth:SIMPLE) cause:org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container. 
NMToken for application attempt : appattempt_1382038445650_0002_000001 was used for starting container with container token issued for application attempt : appattempt_1382038445650_0001_000001

      Attachments

        1. YARN-1321.patch
          19 kB
          Alejandro Abdelnur
        2. YARN-1321-20131029.txt
          19 kB
          Vinod Kumar Vavilapalli
        3. YARN-1321.patch
          18 kB
          Alejandro Abdelnur
        4. YARN-1321.patch
          20 kB
          Alejandro Abdelnur
        5. YARN-1321.patch
          19 kB
          Alejandro Abdelnur
        6. YARN-1321.patch
          19 kB
          Alejandro Abdelnur
        7. YARN-1321.patch
          32 kB
          Alejandro Abdelnur

        Activity

          People

            tucu00 Alejandro Abdelnur
            tucu00 Alejandro Abdelnur
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: