Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3607

Port missing new API mapreduce lib classes to 1.x

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.0.1
    • client
    • None
    • Reviewed

    Description

      There are a number of classes under mapreduce.lib that are not present in the 1.x series. Including these would help users and downstream projects using the new MapReduce API migrate to later versions of Hadoop in the future.

      A few examples of where this would help:

      • Sqoop uses mapreduce.lib.db.DBWritable and mapreduce.lib.input.CombineFileInputFormat (SQOOP-384).
      • Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822).
      • HBase has a backport of mapreduce.lib.partition.InputSampler and TotalOrderPartitioner (in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - it would be better if it used the ones in Hadoop.

      Attachments

        1. MAPREDUCE-3607.patch
          315 kB
          Thomas White
        2. MAPREDUCE-3607.patch
          550 kB
          Thomas White
        3. MAPREDUCE-3607.patch
          551 kB
          Thomas White

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-334 Change mapred.lib code to use new api

          • Major - Major loss of function.
          • Resolved
          is required by

          Bug - A problem which impairs or prevents the functions of the product. SQOOP-384 Sqoop is incompatible with Hadoop prior to 0.21

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue SQOOP-413 Port files org.apache.hadoop.mapreduce.lib.{db,input}.* from CDH3/Hadoop-0.21 to sqoop

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              tomwhite Thomas White
              tomwhite Thomas White
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: