Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3883

Document yarn.nodemanager.delete.debug-delay-sec configuration property

    XMLWordPrintableJSON

Details

    Description

      If you are using Yarn's nodemanager, you can add to your configuration:

        <property>
          <name>yarn.nodemanager.delete.debug-delay-sec</name>
          <value>10000000</value>
        </property>
      

      to save the environmental directories of the applications (by default in /tmp/nm-local-dir) that the nodemanager starts so that you can examine them later.

      Set the above value long enough so that you have time to examine the contents before the nodemanager's DeletionService removes them.

      This setting is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java, and used in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java.

      It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).

      Attachments

        1. MAPREDUCE-3883.patch
          1 kB
          Eugene Joseph Koontz
        2. MAPREDUCE-3883.patch
          3 kB
          Eugene Joseph Koontz
        3. MAPREDUCE-3883.patch
          3 kB
          Eugene Joseph Koontz
        4. MAPREDUCE-3883.patch
          3 kB
          Eugene Joseph Koontz

        Issue Links

          Activity

            People

              ekoontz Eugene Joseph Koontz
              ekoontz Eugene Joseph Koontz
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: