XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • SystemML 1.1
    • None
    • None

    Description

      Due to lazy evaluation, many spark instructions propagate nnz only if they can be exactly inferred from the input meta data. Especially for ultra-sparse matrices this poses a challenge because intermediates quickly reach a state where they're assumed to be dense. However, many operations such as right indexing allow to upper bound the nnz with the nnz in the input, which can be propagated and exploited in subsequent instructions.

      Attachments

        Activity

          People

            mboehm7 Matthias Boehm
            mboehm7 Matthias Boehm
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: