Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
I tried to slow down the wordcount example by using a slow sdcard as input, to "watch" stratosphere reading the input splits. I checked other partitions and drives and found that it only works with my drive D:. The stratosphere runtime is located on D:.
Command:
```
D:\stratosphereWorkEnvironment\workspace\stratosphere\stratosphere-dist\target\stratosphere-dist-0.5-SNAPSHOT-bin\strato
sphere-0.5-SNAPSHOT\bin>java -Xmx512m -cp "D:\stratosphereWorkEnvironment\workspace\stratosphere\stratosphere-dist\targe
t\stratosphere-dist-0.5-SNAPSHOT-bin\stratosphere-0.5-SNAPSHOT\bin\..\lib*" eu.stratosphere.client.CliFrontend run --ja
rfile D:/stratosphereWorkEnvironment/workspace/stratosphere/stratosphere-dist/target/stratosphere-dist-0.5-SNAPSHOT-bin/
stratosphere-0.5-SNAPSHOT/examples/stratosphere-scala-examples-0.5-SNAPSHOT-WordCount.jar --arguments 10 file://G:/hamle
t.txt file://D:/stratosphereWorkEnvironment/testdata/wordcount/wordcount-result.txt -v -w
```
Exceptions:
```
14/05/28 17:33:27 WARN io.DelimitedInputFormat: Could not determine statistics for file 'file://G:/hamlet.txt' due to an
io error: File file://G:/hamlet.txt does not exist.
14/05/28 17:33:27 ERROR client.JobClient: ERROR: eu.stratosphere.nephele.executiongraph.GraphConversionException: Cannot
compute input splits for CHAIN DataSource(File file://G:/hamlet.txt) -> Map (<Unnamed Mapper>): java.io.FileNotFoundExc
eption: File file://G:/hamlet.txt does not exist.
at eu.stratosphere.core.fs.local.LocalFileSystem.getFileStatus(LocalFileSystem.java:100)
at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:410)
at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:70)
at eu.stratosphere.pact.runtime.task.DataSourceTask.computeInputSplits(DataSourceTask.java:332)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:552)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:555)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)
Error: The program execution failed: eu.stratosphere.nephele.executiongraph.GraphConversionException: Cannot compute inp
ut splits for CHAIN DataSource(File file://G:/hamlet.txt) -> Map (<Unnamed Mapper>): java.io.FileNotFoundException: File
file://G:/hamlet.txt does not exist.
at eu.stratosphere.core.fs.local.LocalFileSystem.getFileStatus(LocalFileSystem.java:100)
at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:410)
at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:70)
at eu.stratosphere.pact.runtime.task.DataSourceTask.computeInputSplits(DataSourceTask.java:332)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:552)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:555)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)
eu.stratosphere.client.program.ProgramInvocationException: The program execution failed: eu.stratosphere.nephele.executi
ongraph.GraphConversionException: Cannot compute input splits for CHAIN DataSource(File file://G:/hamlet.txt) -> Map (<U
nnamed Mapper>): java.io.FileNotFoundException: File file://G:/hamlet.txt does not exist.
at eu.stratosphere.core.fs.local.LocalFileSystem.getFileStatus(LocalFileSystem.java:100)
at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:410)
at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:70)
at eu.stratosphere.pact.runtime.task.DataSourceTask.computeInputSplits(DataSourceTask.java:332)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:552)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:555)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)
at eu.stratosphere.client.program.Client.run(Client.java:237)
at eu.stratosphere.client.program.Client.run(Client.java:203)
at eu.stratosphere.client.program.Client.run(Client.java:197)
at eu.stratosphere.client.program.Client.run(Client.java:165)
at eu.stratosphere.client.CliFrontend.run(CliFrontend.java:337)
at eu.stratosphere.client.CliFrontend.parseParameters(CliFrontend.java:852)
at eu.stratosphere.client.CliFrontend.main(CliFrontend.java:878)
```
---------------- Imported from GitHub ----------------
Url: https://github.com/stratosphere/stratosphere/issues/881
Created by: tobwiens
Labels:
Created at: Wed May 28 18:18:25 CEST 2014
State: closed