Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-448

orphan process left on DataNode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.1.0
    • None
    • mapreduce
    • None
    • Hadoop 1.0 with Fedora linux OS

    Description

      I am able to run some simple Graph job successfully but there is one orphan process left on the data node per job run.

      Please advise.

      Really appreciated your time and help.

      Min

      ----- details ------------------

      My job:
      hadoop jar /usr/local/giraph-0.1/lib/giraph-0.1.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.zkList="10.244.140.108:22181,10.244.141.225:22181,10.244.140.161:22181" -libjars /usr/local/giraph-0.1//lib/guava-r09.jar,/usr/local/giraph-0.1//lib/zookeeper-3.3.3.jar,/home/mitu/jars/commons-io-2.1.jar,/home/mitu/json-20090211.jar,/home/mitu/gson-2.2.2.jar,/usr/local/giraph-0.1/lib/base64-2.3.8.jar -Dquorum=d-sjc-00513560.corp.ebay.com /user/mitu/giraphData/sssp/input /user/mitu/giraphData/sssp/output 1 2

      --------------
      Process left on the data node after job FINISHED successfully

      mapred 24885 24004 5 16:47 ? 00:00:04 /usr/java/jdk1.6.0_35/jre/bin/java -Djava.library.path=/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/native/Linux-amd64-64:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work -Xmx2g -Djava.io.tmpdir=/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work/tmp -classpath /usr/local/hadoop-0.20.2-cdh3u4a/conf:/usr/java/default//lib/tools.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/..:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../hadoop-core-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/ant-contrib-1.0b3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-cli-1.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-el-1.0.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-httpclient-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-net-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/core-3.1.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/guava-r09-jarjar.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hadoop-fairscheduler-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-core-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-mapper-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-util-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/junit-4.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/log4j-1.2.15.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/mockito-all-1.8.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-20081211.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-api-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/conf/sflowagent.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/classes:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/job.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-1938241819864817775_-1820091806_124600052/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/guava-r09.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/3379343582640146181_1388448658_124600217/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/zookeeper-3.3.3.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/8554092968028345678_-45346133_124600290/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/commons-io-2.1.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-8215982196372453677_936989764_124600348/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapre
      mapred 25042 21916 0 16:48 pts/0 00:00:00 grep --color=auto 24885

      Attachments

        Activity

          People

            Unassigned Unassigned
            mintu Min Tu
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: