Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5710

Counter MAP_INPUT_BYTES missing from new mapreduce api.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      MapTask, with current new mapreduce api, does not maintain MAP_INPUT_BYTES counter. Since RecordReader doesnot have getPos() api, it is not possible for the map task to maintain. Individual record readers (LineRecordReader, SequenceFileRecordReader) could be modified to maintain the same.

      Attachments

        1. patch-5710.txt
          4 kB
          Amareshwari Sriramadasu
        2. patch-5710-1.txt
          11 kB
          Amareshwari Sriramadasu
        3. patch-5710-2.txt
          13 kB
          Amareshwari Sriramadasu
        4. patch-5710-3.txt
          13 kB
          Amareshwari Sriramadasu

        Issue Links

          blocks

          Sub-task - The sub-task of the issue MAPREDUCE-362 Change org.apache.hadoop.examples.Sort to use new api.

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-5717 Create public enum class for the Framework counters in org.apache.hadoop.mapreduce

          • Major - Major loss of function.
          • Closed

          Activity

            People

              amareshwari Amareshwari Sriramadasu
              amareshwari Amareshwari Sriramadasu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: