Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1852

SparkSQL Queries with Sorts run before the user asks them to

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.0.1, 1.1.0
    • SQL
    • None

    Description

      This is related to SPARK-1021 but will not be fixed by that since we do our own partitioning.

      Part of the problem here is that we calculate the range partitioning too eagerly. Though this could also be alleviated by avoiding the call to toRdd for non DDL queries.

      Attachments

        Issue Links

          Activity

            People

              lian cheng Cheng Lian
              marmbrus Michael Armbrust
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: