Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14772

Python ML Params.copy treats uid, paramMaps differently than Scala

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.0
    • 2.1.1, 2.2.0
    • ML, PySpark
    • None

    Description

      In PySpark, ml.param.Params.copy does not quite match the Scala implementation:

      • It does not copy the UID
      • It does not respect the difference between defaultParamMap and paramMap. This is an issue with _copyValues.

      Attachments

        Issue Links

          Is contained by

          Umbrella - An overarching type made of sub-tasks SPARK-14771 Python ML Param and UID issues

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue SPARK-20506 ML, Graph 2.2 QA: Programming guide update and migration guide

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Pull request #12888 [Github] Pull Request #12888 (hujy)

          Pull request #16772 [Github] Pull Request #16772 (BryanCutler)

          Pull request #17048 [Github] Pull Request #17048 (BryanCutler)

          Activity

            People

              bryanc Bryan Cutler
              josephkb Joseph K. Bradley
              Joseph K. Bradley Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: