Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16592

Improving ml.Logistic Regression on speed and scalability

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • ML

    Description

      With the spreading application of Apache Spark* logistic regression, we've seen more and more requirements come up about improving the speed and scalability. Many suggestions and discussions have been evolving in the developer and user communities. While it may be difficult to find an optimization for all the cases, understanding the various scenarios and approaches will be important.

      As discussed with josephkb, this JIRA is created for discussion and collecting efforts on the optimization work of LR (logistic regression). All the ongoing related JIRA will be linked here, as well as new ideas and possibilities.

      Users are encouraged to share their experiences/expectations on LR and track the development status from the community. Developers can leverage the JIRA to browse existing efforts, make communication and introduce research/development resources.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7159 Support multiclass logistic regression in spark.ml

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3181 Add Robust Regression Algorithm with Huber Estimator

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-10078 Vector-free L-BFGS

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-14464 Logistic regression performs poorly for very large vectors, even when the number of non-zero features is small

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16494 Upgrade breeze version to 0.12

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-17133 Improvements to linear methods in Spark

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              yuhaoyan yuhao yang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: