Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35419

Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.2.0
    • PySpark
    • None

    Description

      SPARK-33407 added the simplification of the stacktraces in Python UDFs which hides unnecessary internal traceback which makes users focus on the exceptions from their own codes.

      This JIRA aims to enable it by default.

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: