Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13068

Extend pyspark ml paramtype conversion

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • None
    • 2.0.0
    • ML, PySpark
    • None

    Description

      In SPARK-7675 we added type conversion for PySpark ML params. We should follow up and support param type conversion for lists and nested structures as required. This blocks having all PySpark ML params having type information.

      Attachments

        Issue Links

          contains

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-10009 PySpark Param of Vector type can be set with Python array or numpy.array

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue SPARK-7376 Python: Add validation functionality to individual Param

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-13066 Specify types for per-model/estimator params in ML to allow automatic type conversion

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          supercedes

          Sub-task - The sub-task of the issue SPARK-7376 Python: Add validation functionality to individual Param

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-13066 Specify types for per-model/estimator params in ML to allow automatic type conversion

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Pull request #11099 [Github] Pull Request #11099 (sethah)

          Pull request #11663 [Github] Pull Request #11663 (sethah)

          Web Link GitHub Pull Request #11663

          Activity

            People

              sethah Seth Hendrickson
              holden Holden Karau
              Joseph K. Bradley Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: