Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17409

Query in CTAS is Optimized Twice

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.1.0
    • 2.1.0
    • SQL

    Description

      The query in CTAS is optimized twice, as reported in the PR: https://github.com/apache/spark/pull/14797

      Some analyzer rules have assumptions on logical plans, optimizer may break these assumption, we should not pass an optimized query plan into QueryExecution (will be analyzed again), otherwise we may some weird bugs.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-17892 Query in CTAS is Optimized Twice (branch-2.0)

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Pull request #15048 [Github] Pull Request #15048 (gatorsmile)

          Pull request #15459 [Github] Pull Request #15459 (gatorsmile)

          Activity

            People

              smilegator Xiao Li
              smilegator Xiao Li
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: