Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5874

How to improve the current ML pipeline API?

    XMLWordPrintableJSON

Details

    • Brainstorming
    • Status: Resolved
    • Critical
    • Resolution: Done
    • None
    • None
    • ML
    • None

    Description

      I created this JIRA to collect feedbacks about the ML pipeline API we introduced in Spark 1.2. The target is to graduate this set of APIs in 1.4 with confidence, which requires valuable input from the community. I'll create sub-tasks for each major issue.

      Design doc (WIP): https://docs.google.com/a/databricks.com/document/d/1plFBPJY_PriPTuMiFYLSm7fQgD1FieP4wt3oMVKMGcc/edit#

      Attachments

        Issue Links

          incorporates

          Umbrella - An overarching type made of sub-tasks SPARK-8984 Developer documentation for ML Pipelines

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-14033 Merging Estimator & Model

          • Major - Major loss of function.
          • Closed

          Umbrella - An overarching type made of sub-tasks SPARK-10413 ML models should support prediction on single instances

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' SPARK-7146 Should ML sharedParams be a public API?

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-11107 spark.ml should support more input column types: umbrella

          • Major - Major loss of function.
          • Resolved
          relates to

          Umbrella - An overarching type made of sub-tasks SPARK-6725 Model export/import for Pipeline API (Scala)

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' SPARK-19498 Discussion: Making MLlib APIs extensible for 3rd party libraries

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              mengxr Xiangrui Meng
              mengxr Xiangrui Meng
              Votes:
              1 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: