Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
Impala 2.0
-
None
-
None
Description
We don't start up additional scanner threads if there is memory pressure. This is based on the per scanner thread mem estimate, which can be orders of magnitude too low for compressed text.
SCANNER_THREAD_MEM_USAGE in
https://github.com/cloudera/Impala/blob/master/be/src/exec/hdfs-scan-node.cc