Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18587

Remove handleInvalid from QuantileDiscretizer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Won't Fix
    • None
    • None
    • ML
    • None

    Description

      HandleInvalid only happens when Bucketizer transforming a dataset which contains NaN, however, when the training dataset containing NaN, QuantileDiscretizer will always ignore them. So we should keep handleInvalid in Bucketizer and remove it from QuantileDiscretizer.

      Attachments

        Issue Links

          Is contained by

          Sub-task - The sub-task of the issue SPARK-18318 ML, Graph 2.1 QA: API: New Scala APIs, docs

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Pull request #16011 [Github] Pull Request #16011 (yanboliang)

          Activity

            People

              yanboliang Yanbo Liang
              yanboliang Yanbo Liang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: