Details
-
Improvement
-
Status: Reopened
-
Major
-
Resolution: Unresolved
-
1.14.0
-
None
-
None
Description
SelectionVectorRemover in most of the cases is downstream to Filter which reduces the number of records to be copied in output container. In those cases if SelectionVectorRemover can pack the output batch to approximate maximum utilization based on RecordBatchSizer target record count, that will reduce the number of output batches from it and will help to improve performance. During Lateral & Unnest Performance evaluation we have noticed a significant decrease in performance as number of batches increases for same number of rows (i.e. Batch is not fully packed)
Attachments
Issue Links
- is required by
-
DRILL-6211 Optimizations for SelectionVectorRemover
- Resolved