Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6167

bin/hadoop script doesn't allow for different memory settings for each daemon type

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.20.0
    • None
    • None
    • None

    Description

      bin/hadoop assumes that all daemon types ( namenode, datanode, jobtracker, tasktracker ), all use the same memory settings.. (HADOOP_HEAPSIZE).

      I propose changes to that script to allow overriding the default memory ( HADOOP_HEAPSIZE ), with daemon specific OPTS (HADOOP_NAMENODE_OPTS, etc ).

      Basically at the bottom of the bin/hadoop script, it will check to see if the user has already set "-Xmx" in the HADOOP_OPTS variable.. if so, then it will ignore the JAVA_HEAP_SIZE variable..

      as such:

      1. run it
        if [[ $HADOOP_OPTS == -Xmx ]]; then
        exec "$JAVA" $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@"
        else
        exec "$JAVA" $JAVA_HEAP_MAX $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@"
        fi

      I will attach the file as I have modified it..

      Attachments

        1. hadoop
          10 kB
          Fernando Padilla
        2. hadoop-script.diff
          0.8 kB
          Fernando Padilla

        Issue Links

          Activity

            People

              Unassigned Unassigned
              fern Fernando Padilla
              Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: