Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30223

queries in thrift server may read wrong SQL configs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 3.0.0
    • None
    • SQL
    • None

    Description

      The Spark thrift server creates many SparkSessions to serve requests, and the thrift server serves requests using a single thread. One thread can only have one active SparkSession, so SQLCong.get can't get the proper conf from the session that runs the query.

      Whenever we issue an action on a SparkSession, we should set this session as active session, e.g. `SparkSession.sql`.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-30798 Scope Session.active in QueryExecution

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-38328 SQLConf.get flaky causes NON-default spark session settings being lost

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              cloud_fan Wenchen Fan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: