Major Description
When there is any partial download, or download error it is not cleaned up, and sparkR.session will continue to stuck with no error message.
> sparkR.session() Spark not found in SPARK_HOME: Spark not found in the cache directory. Installation will start. MirrorUrl not provided. Looking for preferred site from apache website... Preferred mirror site found: http://www-eu.apache.org/dist/spark Downloading spark-2.1.0 for Hadoop 2.7 from: - http://www-eu.apache.org/dist/spark/spark-2.1.0/spark-2.1.0-bin-hadoop2.7.tgz trying URL 'http://www-eu.apache.org/dist/spark/spark-2.1.0/spark-2.1.0-bin-hadoop2.7.tgz' Content type 'application/x-gzip' length 195636829 bytes (186.6 MB) downloaded 31.9 MB Installing to C:\Users\felix\AppData\Local\spark\spark\Cache Error in untar2(tarfile, files, list, exdir) : incomplete block on file In addition: Warning message: In download.file(remotePath, localPath) : downloaded length 33471940 != reported length 195636829 > sparkR.session() Spark not found in SPARK_HOME: spark-2.1.0 for Hadoop 2.7 found, setting SPARK_HOME to C:\Users\felix\AppData\Local\spark\spark\Cache/spark-2.1.0-bin-hadoop2.7 Launching java with spark-submit command C:\Users\felix\AppData\Local\spark\spark\Cache/spark-2.1.0-bin-hadoop2.7/bin/spark-submit2.cmd sparkr-shell C:\Users\felix\AppData\Local\Temp\RtmpCqNdne\backend_port16d04191e7
Directory of C:\Users\felix\AppData\Local\spark\spark\Cache 01/13/2017 11:25 AM <DIR> spark-2.1.0-bin-hadoop2.7 01/13/2017 11:25 AM 33,471,940 spark-2.1.0-bin-hadoop2.7.tgz
