Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7137

Add checkInputColumn back to Params and print more info

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 1.4.0
    • 1.5.0
    • ML
    • None

    Description

      In the PR for https://issues.apache.org/jira/browse/SPARK-5957, Params.checkInputColumn was moved to SchemaUtils and renamed to checkColumnType. The downside is that it no longer has access to the parameter info, so it cannot state which input column parameter was incorrect.

      We should keep checkColumnType but also add checkInputColumn back to Params. It should print out the parameter name and description. Internally, it may call checkColumnType.

      Attachments

        Issue Links

          Activity

            People

              rekhajoshm Rekha Joshi
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: