Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5565

job clean up fails on secure cluster as the file system is not created in the context of the ugi running the job

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • 1.2.1
    • 1.3.0
    • jobtracker
    • None

    Description

      On secure clusters we see the following exceptions in the jt log

      2013-10-04 04:52:31,753 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:tt/host@REALM cause:javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]

      And after the job finishes the staging dir is not cleaned up. While debugging with acmurthy we determined that file system object needs to be created in the the context of the user who ran the job.

      Job however successfully completes

      Attachments

        1. MAPREDUCE-5565.patch
          1 kB
          Arun Murthy
        2. MAPREDUCE-5565.patch
          1 kB
          Arun Murthy

        Activity

          People

            acmurthy Arun Murthy
            arpitgupta Arpit Gupta
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: