Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7443 MLlib 1.4 QA plan
  3. SPARK-7536

Audit MLlib Python API for 1.4

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • 1.5.0
    • MLlib, PySpark
    • None

    Description

      *NOTE: This is targeted at 1.5.0 because it has so many useful links for JIRAs targeted for 1.5.0. In the future, we should create a new JIRA for linking future items.*

      For new public APIs added to MLlib, we need to check the generated HTML doc and compare the Scala & Python versions. We need to track:

      • Inconsistency: Do class/method/parameter names match? SPARK-7667
      • Docs: Is the Python doc missing or just a stub? We want the Python doc to be as complete as the Scala doc. SPARK-7666, SPARK-6173
      • API breaking changes: These should be very rare but are occasionally either necessary (intentional) or accidental. These must be recorded and added in the Migration Guide for this release. SPARK-7665
        • Note: If the API change is for an Alpha/Experimental/DeveloperApi component, please note that as well.
      • Missing classes/methods/parameters: We should create to-do JIRAs for functionality missing from Python.

      Attachments

        Issue Links

          contains

          Sub-task - The sub-task of the issue SPARK-4118 Create python bindings for Streaming KMeans

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-4127 Streaming Linear Regression- Python bindings

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-6094 Add MultilabelMetrics in PySpark/MLlib

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-6258 Python MLlib API missing items: Clustering

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-6263 Python MLlib API missing items: Utils

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-7633 Streaming Logistic Regression- Python bindings

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-5962 [MLLIB] Python support for Power Iteration Clustering

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7604 Python API for PCA and PCAModel

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7605 Python API for ElementwiseProduct

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7639 Add Python API for Statistics.kernelDensity

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7638 Python API for pmml.export

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-6259 Python API for LDA

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-9122 spark.mllib regression should support batch predict

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-8068 Add confusionMatrix method at class MulticlassMetrics in pyspark/mllib

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. SPARK-7667 MLlib Python API consistency check

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-7203 Python API for local linear algebra

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-3258 Python API for streaming MLlib algorithms

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-5694 Python API for evaluation metrics

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-6100 Distributed linear algebra in PySpark/MLlib

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-6173 Python doc parity with Scala/Java in MLlib

          • Major - Major loss of function.
          • Resolved

          Documentation - Documentation or Website SPARK-7665 MLlib Python API breaking changes check between 1.3 & 1.4

          • Major - Major loss of function.
          • Resolved

          Documentation - Documentation or Website SPARK-7666 MLlib Python doc parity check

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-8757 Check missing and add user guide for MLlib Python API

          • Major - Major loss of function.
          • Closed

          Activity

            People

              yanboliang Yanbo Liang
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: