Description
When a order by clause has a non-deterministic expression, we actually evaluate it twice, once in the exchange operator when we try to figure out the range partitioner's boundaries and once in the sort operator. We should use a project to materialize the result first.
Attachments
Issue Links
- is duplicated by
-
SPARK-6009 IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND ()
- Resolved
- links to