Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
0.6.2
-
None
-
None
Description
For many of the rescheduled tasks task tracker doesn't generate job.xml causing the task to fail. The exception appears in Job tracker logs and not in task tracker's logs.
possibly related to Hadoop-543
2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
Attachments
Issue Links
- duplicates
-
HADOOP-737 TaskTracker's job cleanup loop should check for finished job before deleting local directories
- Closed