Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8472 YARN Container Phase 2
  3. YARN-6456

Allow administrators to control available container runtimes and set defaults for all containers

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0
    • nodemanager

    Description

       

      With LCE, there are multiple ContainerRuntimes available for handling different types of containers; default, docker, java sandbox. Admins should have the ability to override the user decision and set a single global ContainerRuntime to be used for all containers.

      Original Description:

      One reason to use Docker containers is to be able to isolate different workloads, even, if they run as the same user.

      I have noticed some issues in the current design:
      1. DockerLinuxContainerRuntime mounts containerLocalDirs nm-local-dir/usercache/user/appcache/application_1491598755372_0011/ and userLocalDirs nm-local-dir/usercache/user/, so that a container can see and modify the files of another container. I think the application file cache directory should be enough for the container to run in most of the cases.
      2. The whole cgroups directory is mounted. Would the container directory be enough?
      3. There is no way to enforce exclusive use of Docker for all containers. There should be an option that it is not the user but the admin that requires to use Docker.

      Attachments

        1. YARN-6456.001.patch
          28 kB
          Craig Condit
        2. YARN-6456.002.patch
          28 kB
          Craig Condit
        3. YARN-6456.003.patch
          30 kB
          Craig Condit
        4. YARN-6456.004.patch
          23 kB
          Craig Condit
        5. YARN-6456.005.patch
          23 kB
          Craig Condit
        6. YARN-6456-ForceDockerRuntimeIfSupported.patch
          11 kB
          Eric Badger

        Activity

          People

            ccondit-target Craig Condit
            miklos.szegedi@cloudera.com Miklos Szegedi
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: