Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1484

Framework should not sort the input splits

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently the framework sorts the input splits by size before the job is submitted. This makes it very difficult to run map only jobs that transform the input because the assignment of input names to output names isn't obvious. We fixed this once in HADOOP-1440, but the fix was broken so it was rolled back.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated: