Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
It would be nice to have a configurable limit such that any task that wrote data to the local filesystem beyond that limit would fail quickly rather than waiting for the disk to fill much later, impacting other jobs on the cluster.
This is essentially asking for the Tez version of MAPREDUCE-6489.
Attachments
Issue Links
- relates to
-
MAPREDUCE-6489 Fail fast rogue tasks that write too much to local disk
- Resolved
-
TEZ-4112 Fast fail tez jobs when local scratch dir limitation is exceeded
- Patch Available
- links to
merged to master, thanks ayushtkn for the review and rbalamohan for the review!