Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
0.7.1
-
None
-
None
-
None
Description
If a Tez task receives too much input data and needs to spill the inputs to disk it ends up using a path that is not container-specific. Therefore YARN will not automatically cleanup these files when the container exits as it should, and instead the files linger until the entire application completes.
Attachments
Issue Links
- is related to
-
TEZ-3877 Delete unordered spill files once merge is done
- Closed