Description
Here's how we compile:
$ mvn -Phadoop_trunk -DskipTests -Dhadoop.version=2.0.0-alpha site package
Here's how we run:
$ export GIRAPH_HOME=/usr/lib/giraph $ hadoop jar /usr/lib/giraph/giraph-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 3 -V 100000 -w 3
Here's what we get in the task logs (as a side note – once 3 of the 8 tasks fail that way the entire job hangs forever which could be a bug in and of itself):
2012-05-31 10:31:28,518 WARN [main]
org.apache.hadoop.mapred.YarnChild: Exception running child :
java.lang.RuntimeException: java.lang.NoSuchFieldException: versionID
at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:170)
at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.(WritableRpcEngine.java:110)
at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:224)
at $Proxy11.putVertexList(Unknown Source)
at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:921)
at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:322)
at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:594)
at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:473)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.lang.NoSuchFieldException: versionID
at java.lang.Class.getField(Class.java:1520)
at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:166)
... 15 more
Attachments
Issue Links
- is related to
-
BIGTOP-570 Build package for Apache Giraph
-
- Closed
-
-
GIRAPH-201 add Hadoop 2.0.0 profile to maven
-
- Resolved
-
- relates to
-
GIRAPH-208 LocalTestMode's zookeeper directory is not being cleaned up after job runs
-
- Resolved
-