Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-881

Using another drive C:/D: other than where the stratosphere distribution is, results in file not found

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • pre-apache
    • None

    Description

      I tried to slow down the wordcount example by using a slow sdcard as input, to "watch" stratosphere reading the input splits. I checked other partitions and drives and found that it only works with my drive D:. The stratosphere runtime is located on D:.

      Command:
      ```
      D:\stratosphereWorkEnvironment\workspace\stratosphere\stratosphere-dist\target\stratosphere-dist-0.5-SNAPSHOT-bin\strato
      sphere-0.5-SNAPSHOT\bin>java -Xmx512m -cp "D:\stratosphereWorkEnvironment\workspace\stratosphere\stratosphere-dist\targe
      t\stratosphere-dist-0.5-SNAPSHOT-bin\stratosphere-0.5-SNAPSHOT\bin\..\lib*" eu.stratosphere.client.CliFrontend run --ja
      rfile D:/stratosphereWorkEnvironment/workspace/stratosphere/stratosphere-dist/target/stratosphere-dist-0.5-SNAPSHOT-bin/
      stratosphere-0.5-SNAPSHOT/examples/stratosphere-scala-examples-0.5-SNAPSHOT-WordCount.jar --arguments 10 file://G:/hamle
      t.txt file://D:/stratosphereWorkEnvironment/testdata/wordcount/wordcount-result.txt -v -w
      ```
      Exceptions:
      ```
      14/05/28 17:33:27 WARN io.DelimitedInputFormat: Could not determine statistics for file 'file://G:/hamlet.txt' due to an
      io error: File file://G:/hamlet.txt does not exist.
      14/05/28 17:33:27 ERROR client.JobClient: ERROR: eu.stratosphere.nephele.executiongraph.GraphConversionException: Cannot
      compute input splits for CHAIN DataSource(File file://G:/hamlet.txt) -> Map (<Unnamed Mapper>): java.io.FileNotFoundExc
      eption: File file://G:/hamlet.txt does not exist.
      at eu.stratosphere.core.fs.local.LocalFileSystem.getFileStatus(LocalFileSystem.java:100)
      at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:410)
      at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:70)
      at eu.stratosphere.pact.runtime.task.DataSourceTask.computeInputSplits(DataSourceTask.java:332)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:552)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
      at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
      at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)

      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:555)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
      at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
      at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)

      Error: The program execution failed: eu.stratosphere.nephele.executiongraph.GraphConversionException: Cannot compute inp
      ut splits for CHAIN DataSource(File file://G:/hamlet.txt) -> Map (<Unnamed Mapper>): java.io.FileNotFoundException: File
      file://G:/hamlet.txt does not exist.
      at eu.stratosphere.core.fs.local.LocalFileSystem.getFileStatus(LocalFileSystem.java:100)
      at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:410)
      at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:70)
      at eu.stratosphere.pact.runtime.task.DataSourceTask.computeInputSplits(DataSourceTask.java:332)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:552)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
      at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
      at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)

      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:555)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
      at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
      at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)

      eu.stratosphere.client.program.ProgramInvocationException: The program execution failed: eu.stratosphere.nephele.executi
      ongraph.GraphConversionException: Cannot compute input splits for CHAIN DataSource(File file://G:/hamlet.txt) -> Map (<U
      nnamed Mapper>): java.io.FileNotFoundException: File file://G:/hamlet.txt does not exist.
      at eu.stratosphere.core.fs.local.LocalFileSystem.getFileStatus(LocalFileSystem.java:100)
      at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:410)
      at eu.stratosphere.api.common.io.FileInputFormat.createInputSplits(FileInputFormat.java:70)
      at eu.stratosphere.pact.runtime.task.DataSourceTask.computeInputSplits(DataSourceTask.java:332)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:552)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
      at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
      at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)

      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.createVertex(ExecutionGraph.java:555)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.constructExecutionGraph(ExecutionGraph.java:273)
      at eu.stratosphere.nephele.executiongraph.ExecutionGraph.<init>(ExecutionGraph.java:174)
      at eu.stratosphere.nephele.jobmanager.JobManager.submitJob(JobManager.java:503)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      at java.lang.reflect.Method.invoke(Unknown Source)
      at eu.stratosphere.nephele.ipc.RPC$Server.call(RPC.java:417)
      at eu.stratosphere.nephele.ipc.Server$Handler.run(Server.java:951)

      at eu.stratosphere.client.program.Client.run(Client.java:237)
      at eu.stratosphere.client.program.Client.run(Client.java:203)
      at eu.stratosphere.client.program.Client.run(Client.java:197)
      at eu.stratosphere.client.program.Client.run(Client.java:165)
      at eu.stratosphere.client.CliFrontend.run(CliFrontend.java:337)
      at eu.stratosphere.client.CliFrontend.parseParameters(CliFrontend.java:852)
      at eu.stratosphere.client.CliFrontend.main(CliFrontend.java:878)
      ```

      ---------------- Imported from GitHub ----------------
      Url: https://github.com/stratosphere/stratosphere/issues/881
      Created by: tobwiens
      Labels:
      Created at: Wed May 28 18:18:25 CEST 2014
      State: closed

      Attachments

        Activity

          People

            Unassigned Unassigned
            github-import GitHub Import
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: