Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40079

Add Imputer inputCols validation for empty input case

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.1.4, 3.3.1, 3.2.3, 3.4.0
    • ML
    • None

    Description

      If Imputer inputCols is empty, the `fit` works fine but when saving model, error will be raised:

      AnalysisException:
      Datasource does not support writing empty or nested empty schemas.
      Please make sure the data schema has at least one or more column(s).

      Attachments

        Activity

          People

            weichenxu123 Weichen Xu
            weichenxu123 Weichen Xu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: