Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-801

job tracker should keep a log of task completion and failure

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9.1
    • 0.11.0
    • None
    • None

    Description

      The JobTracker should track a list of task completion events in JobInProgress.

      So JobClientProtocol & InterTrackerProtocol should get a new method:

      TaskCompletionEvent[] getTaskCompletionEvents(String jobid, int fromEventId) throws IOException;

      TaskCompletionEvent should have:
      int getEventId();
      String getTaskTrackerHttp();
      String getTaskId();
      static public enum Status

      {FAILED, SUCCEEDED}

      ;
      Status getTaskStatus();
      }

      The events will be stored in a List<TaskCompletionEvent> and the eventId is the position in the list.

      These event logs will allow JobClient to display task output to the user as well as provide the start of the fix for HADOOP-248.

      Attachments

        1. Hadoop-801.patch
          19 kB
          Sanjay Dahiya
        2. Hadoop-801.patch
          18 kB
          Sanjay Dahiya
        3. Hadoop-801.patch
          17 kB
          Sanjay Dahiya
        4. Hadoop-801.patch
          13 kB
          Sanjay Dahiya

        Issue Links

          Activity

            People

              sanjay.dahiya Sanjay Dahiya
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: