Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
Impala 2.5.0
Description
If a runtime filter arrives after per-file filtering is done, but before per-scan-range filtering, the filter may cause a header split from an Avro file to be filtered out. However, that means that BaseSequenceScanner::ProcessSplit() is not called, which would otherwise issue the remaining scan ranges in that file. This means that the exit condition for HdfsScanNode::ScannerThread() is not met, as num_unqueued_files_ and progress_ are never set to 0 or num_splits respectively. The scanner threads will therefore spin.
Attachments
Issue Links
- is duplicated by
-
IMPALA-3768 Impala hang in non-partitioned-joins-and-aggs build
- Resolved
- is related to
-
IMPALA-3804 Re-enable per-scan filtering for sequence-based scanners
- Closed