Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-2136

Text to binary block conversions fails for very wide, ultra-sparse data

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 1.1
    • None
    • None

    Description

      org.apache.sysml.runtime.DMLRuntimeException: Unexpected error in sparseToDense().. limit < 0: 1000, -580983032, -1162447040
        at org.apache.sysml.runtime.matrix.data.MatrixBlock.sparseToDense(MatrixBlock.java:1143)
        at org.apache.sysml.runtime.matrix.data.MatrixBlock.examSparsity(MatrixBlock.java:1020)
        at org.apache.sysml.runtime.matrix.mapred.ReblockBuffer.outputBlock(ReblockBuffer.java:312)
        at org.apache.sysml.runtime.matrix.mapred.ReblockBuffer.flushBufferToBinaryBlocks(ReblockBuffer.java:264)
        at org.apache.sysml.runtime.instructions.spark.utils.RDDConverterUtils$CellToBinaryBlockFunction.flushBufferToList(RDDConverterUtils.java:506)
        at org.apache.sysml.runtime.instructions.spark.utils.RDDConverterUtils$TextToBinaryBlockFunction.call(RDDConverterUtils.java:549)
        at org.apache.sysml.runtime.instructions.spark.utils.RDDConverterUtils$TextToBinaryBlockFunction.call(RDDConverterUtils.java:511)

      Attachments

        Activity

          People

            mboehm7 Matthias Boehm
            mboehm7 Matthias Boehm
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: