Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
Impala 3.0, Impala 2.12.0
-
None
-
ghx-label-4
Description
The current admission control treats all backends symmetrically and sets aside the mem_limit. This makes sense for now given that we have the same mem_limit setting for all backends.
One case where this could be somewhat problematic is if you have dedicated coordinators with less memory than the executors, because the coordinator's process memory limit will be fully admitted before the executors.
If you have multiple coordinators and queries are distributed between them this is relatively unlikely to become a problem. If you have a single coordinator this is more of an issue.
Attachments
Issue Links
- depends upon
-
IMPALA-7349 Automatically choose mem_limit based on estimate, clamped to range
- Resolved
- duplicates
-
IMPALA-7486 Admit less memory on dedicated coordinator for admission control purposes
- Resolved