Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Running Release verification process (http://apache.github.io/incubator-systemml/release-process.html) where Univar-Stats.dml failing to execute.
Trying to run following example on Single Node Spark environment.
$ tar -xvzf systemml-0.11.0-incubating.tgz
$ cd systemml-0.11.0-incubating
$ export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
$ $SPARK_HOME/bin/spark-submit SystemML.jar -f scripts/datagen/genRandData4Univariate.dml -exec hybrid_spark -args 1000000 100 10 1 2 3 4 uni.mtx
$ echo '1' > uni-types.csv
$ echo '
' > uni-types.csv.mtd
$ $SPARK_HOME/bin/spark-submit SystemML.jar -f scripts/algorithms/Univar-Stats.dml -exec hybrid_spark -nvargs X=uni.mtx TYPES=uni-types.csv STATS=uni-stats.txt CONSOLE_OUTPUT=TRUE
Exception get is following:
Exception in thread "main" org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 64, column 21 – Problem generating simple inst - CP°*°_Var27·SCALAR·DOUBLE·false°_Var25·SCALAR·DOUBLE·false°_Var28·SCALAR·BOOLEAN
at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:374)
at org.apache.sysml.api.DMLScript.main(DMLScript.java:221)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.sysml.lops.LopsException: ERROR: line 64, column 21 – Problem generating simple inst - CP°*°_Var27·SCALAR·DOUBLE·false°_Var25·SCALAR·DOUBLE·false°_Var28·SCALAR·BOOLEAN
at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1572)
at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1212)
at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:267)
at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:531)
at org.apache.sysml.parser.DMLProgram.getRuntimeProgram(DMLProgram.java:207)
at org.apache.sysml.api.DMLScript.execute(DMLScript.java:633)
at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:360)
... 10 more
Caused by: org.apache.sysml.runtime.DMLRuntimeException: Unexpected ValueType in ArithmeticInstruction.
at org.apache.sysml.runtime.instructions.cp.ArithmeticBinaryCPInstruction.parseInstruction(ArithmeticBinaryCPInstruction.java:80)
at org.apache.sysml.runtime.instructions.CPInstructionParser.parseSingleInstruction(CPInstructionParser.java:321)
at org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruction(InstructionParser.java:45)
at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1559)
Following line in Univar-stats dml causing that exception:
maxDomainSize = max( (K > 1) * maxs );
Its Boolean x Double, causing problem.