Description
In Ad-hoc scenario, we always add limit for the query if user have no special limit value, but not all limit is nesessary.
With the power of AQE, we can eliminate limits using running statistics.
Attachments
Issue Links
- relates to
-
SPARK-48037 SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data
- Resolved
- links to