Description
This is related to SPARK-1021 but will not be fixed by that since we do our own partitioning.
Part of the problem here is that we calculate the range partitioning too eagerly. Though this could also be alleviated by avoiding the call to toRdd for non DDL queries.
Attachments
Issue Links
- relates to
-
SPARK-1021 sortByKey() launches a cluster job when it shouldn't
- Resolved