Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8687

Spark on yarn-client mode can't send `spark.yarn.credentials.file` to executor.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.5.0
    • 1.4.1, 1.5.0
    • YARN
    • None

    Description

      Yarn will set spark.yarn.credentials.file after DriverEndpoint initialized. So executor will fetch the old configuration and will cause the problem.

      Attachments

        Activity

          People

            carlmartin Zhaowei Huang
            carlmartin Zhaowei Huang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: