Bulk Operation

SPARK-37063 Extend SparkSessionExtensions to inject rules into AQE Optimizer

SPARK-37063 Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

SPARK-37063 AQE throw exception should respect SparkFatalException

SPARK-37063 Improve perfermance of ShufflePartitionsUtil createSkewPartitionSpecs

SPARK-37063 Unify get preferred locations for shuffle in AQE

SPARK-37063 Explain formatted does not collect subqueries under query stage in AQE

SPARK-37063 Optimize one row plan in normal and AQE Optimizer

SPARK-37063 Query with cast containing non-nullable columns fails with AQE on Spark 3.1.1

SPARK-37063 AQE can change bhj to smj if no extra shuffle introduce

SPARK-37063 TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

SPARK-37063 Support optimize skewed join through union

SPARK-37063 In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure

SPARK-37063 Add small partition factor for rebalance partitions

SPARK-37063 SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan

SPARK-37063 OptimizeSkewInRebalancePartitions support optimize non-root node

SPARK-37063 Cancel all running job after AQE plan finished

SPARK-37063 AQE dynamic join selection should not apply to non-equi join

SPARK-37063 Demote BroadcastJoin causes performance regression and increases OOM risks

SPARK-37063 Support eliminate limits in AQE Optimizer

SPARK-37063 Make config maxShuffledHashJoinLocalMapThreshold fallback to advisoryPartitionSizeInBytes

SPARK-37063 Completely fix the broadcast timeout issue in AQE

SPARK-37063 Support coalesce partition through union

SPARK-37063 Support fetching shuffle blocks in batch with i/o encryption

SPARK-37063 Add an option in AQE to mitigate skew even if it causes an new shuffle

SPARK-37063 Flaky Test: AdaptiveQueryExecSuite.multiple joins