Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-546

Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.6.2
    • 0.10.0
    • None
    • None

    Description

      For many of the rescheduled tasks task tracker doesn't generate job.xml causing the task to fail. The exception appears in Job tracker logs and not in task tracker's logs.

      possibly related to Hadoop-543

      2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
      at java.io.FileOutputStream.open(Native Method)
      at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
      at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
      at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
      at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
      at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
      at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
      at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
      at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
      at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
      at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
      at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
      at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
      at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
      at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
      at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
      at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
      at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
      at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)

      Attachments

        Issue Links

          Activity

            People

              acmurthy Arun Murthy
              sanjay.dahiya Sanjay Dahiya
              Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: