Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35553 Improve correlated subqueries
  3. SPARK-38180

Allow safe up-cast expressions in correlated equality predicates

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.1.3, 3.0.4, 3.3.0, 3.2.2
    • SQL
    • None

    Description

      Relax the constraint added in SPARK-35080 by allowing safe up-cast expressions in correlated equality predicates. For example: 

      cast(x AS STRING) = outer(x)

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-35080 Correlated subqueries with equality predicates can return wrong results

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #35486 [Github] Pull Request #35486 (allisonwang-db)

          Pull request #35689 [Github] Pull Request #35689 (allisonwang-db)

          Activity

            People

              allisonwang-db Allison Wang
              allisonwang-db Allison Wang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: