Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-618

Deep Learning DML Library

    XMLWordPrintableJSON

Details

    • Epic
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Algorithms
    • None
    • Deep Learning DML Library

    Description

      This issue tracks the creation of a layers-based deep learning library in pure DML.

      The library contains layers with simple forward (function evaluation) and backward (gradient computation) functions for affine, convolution (start with 2D), max-pooling, non-linearities (relu, sigmoid, softmax, etc.), dropout, loss functions, other layers, optimizers, and gradient checks.

      Examples: Please see example scripts and notebooks in the examples folder: https://github.com/apache/systemml/tree/master/scripts/nn/examples.

      SystemML-NN: https://github.com/apache/systemml/tree/master/scripts/nn

      • Layers:
        • Core:
          • Affine
          • Batch Normalization 1D
          • Batch Normalization 2D ("Spatial Batch Normalization")
          • Convolution 2D ("Spatial Convolution")
          • LSTM
          • Max Pooling 2D ("Spatial Max Pooling")
          • RNN
        • Nonlinearities:
          • ReLU
          • Sigmoid
          • Softmax
          • Softmax 2D
          • Tanh
        • Loss:
          • Cross-entropy loss
          • Cross-entropy loss 2D
          • L1 loss
          • L2 loss
          • Log ("Logistic") loss
        • Regularization:
          • Dropout
          • L1 reg
          • L2 reg
      • Optimizers:
        • Adagrad
        • Adam
        • RMSprop
        • SGD
        • SGD w/ Momentum
        • SGD w/ Nesterov Momentum
      • Tests:
        • Gradient Checks
        • Unit Tests

      Attachments

        Issue Links

          is depended upon by

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-1185 SystemML Breast Cancer Project

          • Major - Major loss of function.
          • Resolved
          is part of

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-540 Deep Learning

          • Major - Major loss of function.
          • In Progress
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-409 Extended update in-place support

          • Major - Major loss of function.
          • Open

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-669 Improve PyDML Language

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SYSTEMDS-1566 Possible regression from 0.13 -> 0.14 for MNIST LeNet script

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SYSTEMDS-1621 `max(0, X)` fails with type mismatch

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SYSTEMDS-1686 Transpose Conv2d has incorrect filter shape and incorrect input size argument

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SYSTEMDS-633 Improve Left-Indexing Performance with (Nested) Parfor Loops in UDFs

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SYSTEMDS-845 Compare Performance of LeNet Scripts With & Without Using SystemML-NN

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SYSTEMDS-1561 Improve constant folding during compilation

          • Major - Major loss of function.
          • Closed

          Wish - General wishlist item. SYSTEMDS-1000 Allow users to pass non-1 bias filler in conv_builtin.dml

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. SYSTEMDS-1479 Make Caffe2DML feature-complete

          • Major - Major loss of function.
          • Open
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SYSTEMDS-716 Consumability of SystemML for Deep Learning

          • Major - Major loss of function.
          • Open

          Activity

            People

              dusenberrymw Mike Dusenberry
              dusenberrymw Mike Dusenberry
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: