[MAPREDUCE-1100] User's task-logs filling up local disks on the TaskTrackers - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Won't Fix
Affects Version/s: 0.20.1, 0.20.2, 0.21.0
Fix Version/s: 0.21.1, 0.22.1
Component/s: tasktracker
Labels:
- critical-0.22.0

Target Version/s:

0.22.0

Description

Some user's jobs are filling up TT disks by outrageous logging. mapreduce.task.userlog.limit.kb is not enabled on the cluster. Disks are getting filled up before task-log cleanup via mapred.task.userlog.retain.hours can kick in.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

reducetask-log-level.patch
15/Feb/11 01:37
4 kB
Todd Lipcon
patch-1100-fix-ydist.2.txt
10/Mar/10 10:10
13 kB
Vinod Kumar Vavilapalli
MAPREDUCE-1100-20091216.2.txt
16/Dec/09 18:18
53 kB
Arun Murthy
MAPREDUCE-1100-20091106.txt
06/Nov/09 09:02
79 kB
Vinod Kumar Vavilapalli
MAPREDUCE-1100-20091102.txt
02/Nov/09 09:10
51 kB
Vinod Kumar Vavilapalli

Sub-Tasks

1.	Cleanup of task-logs should happen in TaskTracker instead of the Child		Closed	Amareshwari Sriramadasu
2.	Truncate logs of finished tasks to prevent node thrash due to excessive logging		Resolved	Vinod Kumar Vavilapalli

Activity

People

Assignee:: Vinod Kumar Vavilapalli

Reporter:: Vinod Kumar Vavilapalli

Votes:: 0 Vote for this issue

Watchers:: 26 Start watching this issue

Dates

Created:: 13/Oct/09 08:13

Updated:: 29/Jul/14 18:40

Resolved:: 29/Jul/14 18:40