Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.1.0
-
None
-
None
-
Hadoop 1.0 with Fedora linux OS
Description
I am able to run some simple Graph job successfully but there is one orphan process left on the data node per job run.
Please advise.
Really appreciated your time and help.
Min
----- details ------------------
My job:
hadoop jar /usr/local/giraph-0.1/lib/giraph-0.1.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.zkList="10.244.140.108:22181,10.244.141.225:22181,10.244.140.161:22181" -libjars /usr/local/giraph-0.1//lib/guava-r09.jar,/usr/local/giraph-0.1//lib/zookeeper-3.3.3.jar,/home/mitu/jars/commons-io-2.1.jar,/home/mitu/json-20090211.jar,/home/mitu/gson-2.2.2.jar,/usr/local/giraph-0.1/lib/base64-2.3.8.jar -Dquorum=d-sjc-00513560.corp.ebay.com /user/mitu/giraphData/sssp/input /user/mitu/giraphData/sssp/output 1 2
--------------
Process left on the data node after job FINISHED successfully
mapred 24885 24004 5 16:47 ? 00:00:04 /usr/java/jdk1.6.0_35/jre/bin/java -Djava.library.path=/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/native/Linux-amd64-64:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work -Xmx2g -Djava.io.tmpdir=/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work/tmp -classpath /usr/local/hadoop-0.20.2-cdh3u4a/conf:/usr/java/default//lib/tools.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/..:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../hadoop-core-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/ant-contrib-1.0b3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-cli-1.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-el-1.0.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-httpclient-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-net-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/core-3.1.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/guava-r09-jarjar.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hadoop-fairscheduler-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-core-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-mapper-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-util-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/junit-4.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/log4j-1.2.15.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/mockito-all-1.8.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-20081211.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-api-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/conf/sflowagent.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/classes:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/job.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-1938241819864817775_-1820091806_124600052/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/guava-r09.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/3379343582640146181_1388448658_124600217/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/zookeeper-3.3.3.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/8554092968028345678_-45346133_124600290/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/commons-io-2.1.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-8215982196372453677_936989764_124600348/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapre
mapred 25042 21916 0 16:48 pts/0 00:00:00 grep --color=auto 24885