Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2454

Allow external sorter plugin for MR

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.0-alpha, 2.0.2-alpha, 3.0.0-alpha1
    • 2.0.3-alpha
    • None
    • MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task

    Description

      Define interfaces and some abstract classes in the Hadoop framework to facilitate external sorter plugins both on the Map and Reduce sides.

      Attachments

        1. ReduceInputSorter.java
          5 kB
          Mariappan Asokan
        2. MR-2454-trunkPatchPreview.gz
          48 kB
          Mariappan Asokan
        3. mr-2454-on-mr-279-build82.patch.gz
          44 kB
          Mariappan Asokan
        4. mapreduce-2454-protection-change.patch
          6 kB
          Mariappan Asokan
        5. mapreduce-2454-new-test.patch
          33 kB
          Mariappan Asokan
        6. mapreduce-2454-modified-test.patch
          1 kB
          Mariappan Asokan
        7. mapreduce-2454-modified-code.patch
          67 kB
          Mariappan Asokan
        8. mapreduce-2454.patch
          244 kB
          Mariappan Asokan
        9. mapreduce-2454.patch
          248 kB
          Mariappan Asokan
        10. mapreduce-2454.patch
          250 kB
          Mariappan Asokan
        11. mapreduce-2454.patch
          246 kB
          Mariappan Asokan
        12. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        13. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        14. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        15. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        16. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        17. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        18. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        19. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        20. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        21. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        22. mapreduce-2454.patch
          69 kB
          Mariappan Asokan
        23. mapreduce-2454.patch
          102 kB
          Mariappan Asokan
        24. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        25. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        26. mapreduce-2454.patch
          105 kB
          Mariappan Asokan
        27. mapreduce-2454.patch
          106 kB
          Mariappan Asokan
        28. mapreduce-2454.patch
          106 kB
          Mariappan Asokan
        29. MapOutputSorterAbstract.java
          5 kB
          Mariappan Asokan
        30. MapOutputSorter.java
          1 kB
          Mariappan Asokan
        31. KeyValueIterator.java
          1 kB
          Mariappan Asokan
        32. HadoopSortPlugin.pdf
          61 kB
          Mariappan Asokan
        33. HadoopSortPlugin.pdf
          56 kB
          Mariappan Asokan

        Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1639 Grouping using hashing instead of sorting

          • Major - Major loss of function.
          • Open
          is related to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4482 Backport MR sort plugin(MAPREDUCE-2454) to Hadoop 1.2

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-4049 plugin for generic shuffle service

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4039 Sort Avoidance

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4891 Pluggable merge at reduce side

          • Major - Major loss of function.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              masokan Mariappan Asokan
              masokan Mariappan Asokan
              Votes:
              0 Vote for this issue
              Watchers:
              52 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: