Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2198 Remove the need to run NodeManager as privileged account for Windows Secure Container Executor
  3. YARN-2587

Windows Secure Container Executor: classpath in the job classpath-jar is referencing NM nmPrivate files

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • None
    • None
    • nodemanager

    Description

      The classpath-jar is referencing nmPrivate files:

      Manifest-Version: 1.0
Class-Path: file:/c:/Hadoop/Data/Hadoop/local/usercache/HadoopUser/app
 cache/application_1411394968079_0006/container_1411394968079_0006_01_ 000003 file:/c:/hadoop/hadoop-2.4.1-SNAPSHOT/etc/hadoop/ file:/c:/had oop/hadoop-2.4.1-SNAPSHOT/share/hadoop/common/hadoop-common-3.0.0-SNA PSHOT-tests.jar file:/c:/hadoop/hadoop-2.4.1-SNAPSHOT/share/hadoop/co
...
file:/c:/Hadoop/Data/Hadoop/local
 /nmPrivate/application_1411394968079_0006/container_1411394968079_000 6_01_000003/job.jar/job.jar file:/c:/Hadoop/Data/Hadoop/local/nmPriva
 te/application_1411394968079_0006/container_1411394968079_0006_01_000 003/job.jar/classes/

      This is not allowed in the WSCE enviornment, the container has no read privileges on the nmPrivate paths. Besides that particular jar is copied over into the user appcache.

      Attachments

        1. YARN-2587.1.patch
          5 kB
          Remus Rusanu

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-358 bundle container classpath in temporary jar on all platforms, not just Windows

          • Major - Major loss of function.
          • Open

          Activity

            People

              rusanu Remus Rusanu
              rusanu Remus Rusanu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: