Details
-
Sub-task
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
3.4.0
-
None
-
None
Description
A mix-in interface for ScanBuilder. Data sources can implement this interface to push down all the join or aggregate keys to data sources. A return value true indicates that data source will return input partitions following the clustering keys. Otherwise, a false return value indicates the data source doesn't make such a guarantee, even though it may still report a partitioning that may or may not be compatible with the given clustering keys, and it's Spark's responsibility to group the input partitions whether it can be applied.