Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10817

ML abstraction umbrella

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • ML

    Description

      This is an umbrella for discussing and creating ML abstractions. This was originally handled under SPARK-1856 and SPARK-3702, under which we created the Pipelines API and some Developer APIs for classification and regression.

      This umbrella is for future work, including:

      • Stabilizing the classification and regression APIs
      • Discussing traits vs. abstract classes for abstraction APIs
      • Creating other abstractions not yet covered (clustering, multilabel prediction, etc.)

      Note that SPARK-3702 still has useful discussion and design docs.

      Attachments

        Issue Links

          contains

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' SPARK-7409 Designing multilabel abstractions for spark.ml

          • Major - Major loss of function.
          • Resolved

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' SPARK-7412 Designing distributed prediction model abstractions for spark.ml

          • Major - Major loss of function.
          • Resolved

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' SPARK-7610 Design clustering abstractions for Pipelines API

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue SPARK-3702 Standardize MLlib classes for learners, models

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3251 Clarify learning interfaces

          • Major - Major loss of function.
          • Resolved
          relates to

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' SPARK-19498 Discussion: Making MLlib APIs extensible for 3rd party libraries

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          supercedes

          Umbrella - An overarching type made of sub-tasks SPARK-1856 Standardize MLlib interfaces

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: