Export - CSV (All fields)
Export - CSV (Current fields)
SPARK-38069
improve structured streaming window of calculatedSPARK-36603
Use WeakReference over SoftReference in LevelDB to avoid retaining iterator refs
Pin jinja2 in spark-rm/Dockerfile and add as a required dependency in the release README.md
Update API usage on pyspark pandas documents
Task id in the Stage page timeline is incorrect
The filter of partition including cast function may lead the partition pruning to disable
Add support for calling debugCodegen from Python & Java
Duplicate code implementation of `WritablePartitionedIterator`
Improve error message in default spark session catalog
Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezoneSPARK-34287
Spark aggregate improvement
Move the old partition data to trash instead of deleting it when inserting rewrite hive table
Hive bucketing write support
add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is nullSPARK-35546
Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a better way
Lost the null flag info when show create table
Executors don't get rescheduled in standalone mode when worker dies
Improve ZSTD support
Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12
Support user defined initial state with flatMapGroupsWithState in Structured StreamingSPARK-35800
Improving testability of GroupState in streaming flatMapGroupsWithState
Spark fails to launch executors with very large user classpath lists on YARN
Upgrade ZSTD-JNI to 1.5.0-2
Completely fix the broadcast timeout issue in AQE
Port/integrate Koalas documentation into PySpark
Explicit representation of star in MergeIntoTable's Update and Insert action
Support traversal pruning in the transform function family
MergeIntoTable should avoid ambiguous reference
Upgrade ORC to 1.6.6
JDBC V2 Datasource aggregate push down
aditya
Improve cache block migrationSPARK-30978
Remove multiple workers on the same host support from Standalone backend
SPIP: Support push-based shuffle to improve shuffle efficiency
Incorrect star expansion logic MERGE INSERT * / UPDATE *
Disable validate default values when parsing Avro schemas
Upgrade kubernetes-client to 4.13.2
BoundAttribute issue after optimization by BooleanSimplification and PushFoldableIntoBranches
Upgrade Kafka to 2.8.0
Add RocksDB StateStore implementation
New type coercion syntax rules in ANSI mode
Support configurable Avro schema field matching for positional or by-name
use MemoryUsage to control the size of block
Upgrade to Hadoop 3.3.1
Propagating SPARK_CONF_DIR in K8s and tests
Correlated scalar subqueries must be aggregated
Stabilize Data Source V2 API
Build and test Spark against Scala 2.13
SQL Adaptive Query Execution QA
Make user-defined type (UDT) API public