Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-1257

Univar-Stats scripts failing due to Unexpected ValueType in ArithmeticInstruction

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 0.13
    • None
    • None

    Description

      Running Release verification process (http://apache.github.io/incubator-systemml/release-process.html) where Univar-Stats.dml failing to execute.

      Trying to run following example on Single Node Spark environment.

      $ tar -xvzf systemml-0.11.0-incubating.tgz
      $ cd systemml-0.11.0-incubating
      $ export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
      $ $SPARK_HOME/bin/spark-submit SystemML.jar -f scripts/datagen/genRandData4Univariate.dml -exec hybrid_spark -args 1000000 100 10 1 2 3 4 uni.mtx
      $ echo '1' > uni-types.csv
      $ echo '

      {"rows": 1, "cols": 1, "format": "csv"}

      ' > uni-types.csv.mtd
      $ $SPARK_HOME/bin/spark-submit SystemML.jar -f scripts/algorithms/Univar-Stats.dml -exec hybrid_spark -nvargs X=uni.mtx TYPES=uni-types.csv STATS=uni-stats.txt CONSOLE_OUTPUT=TRUE

      Exception get is following:
      Exception in thread "main" org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 64, column 21 – Problem generating simple inst - CP°*°_Var27·SCALAR·DOUBLE·false°_Var25·SCALAR·DOUBLE·false°_Var28·SCALAR·BOOLEAN
      at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:374)
      at org.apache.sysml.api.DMLScript.main(DMLScript.java:221)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
      at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
      at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
      at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
      at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      Caused by: org.apache.sysml.lops.LopsException: ERROR: line 64, column 21 – Problem generating simple inst - CP°*°_Var27·SCALAR·DOUBLE·false°_Var25·SCALAR·DOUBLE·false°_Var28·SCALAR·BOOLEAN
      at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1572)
      at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1212)
      at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:267)
      at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:531)
      at org.apache.sysml.parser.DMLProgram.getRuntimeProgram(DMLProgram.java:207)
      at org.apache.sysml.api.DMLScript.execute(DMLScript.java:633)
      at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:360)
      ... 10 more
      Caused by: org.apache.sysml.runtime.DMLRuntimeException: Unexpected ValueType in ArithmeticInstruction.
      at org.apache.sysml.runtime.instructions.cp.ArithmeticBinaryCPInstruction.parseInstruction(ArithmeticBinaryCPInstruction.java:80)
      at org.apache.sysml.runtime.instructions.CPInstructionParser.parseSingleInstruction(CPInstructionParser.java:321)
      at org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruction(InstructionParser.java:45)
      at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1559)

      Following line in Univar-stats dml causing that exception:
      maxDomainSize = max( (K > 1) * maxs );

      Its Boolean x Double, causing problem.

      Attachments

        Activity

          No work has yet been logged on this issue.

          People

            mboehm7 Matthias Boehm
            acs_s Arvind Surve
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: