Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22941

Allow SparkSubmit to throw exceptions instead of exiting / printing errors.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • Spark Core
    • None

    Description

      SparkSubmit now can be called by the SparkLauncher library (see SPARK-11035). But if the caller provides incorrect or inconsistent parameters to the app, SparkSubmit will print errors to the output and call System.exit, which is not very user friendly in this code path.

      We should modify SparkSubmit to be more friendly when called this way, while still maintaining the old behavior when called from the command line.

      Attachments

        Issue Links

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: