Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-207

Computing Input Splits on the MR Cluster

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • applicationmaster, mrv2
    • None

    Description

      Instead of computing the input splits as part of job submission, Hadoop could have a separate "job task type" that computes the input splits, therefore allowing that computation to happen on the cluster.

      Attachments

        1. MAPREDUCE-207.patch
          11 kB
          Arun Murthy
        2. MAPREDUCE-207.v02.patch
          11 kB
          Gera Shegalov
        3. MAPREDUCE-207.v03.patch
          11 kB
          Gera Shegalov
        4. MAPREDUCE-207.v05.patch
          10 kB
          Gera Shegalov
        5. MAPREDUCE-207.v06.patch
          14 kB
          Gera Shegalov
        6. MAPREDUCE-207.v07.patch
          15 kB
          Gera Shegalov

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1227 Allow JobTracker to pause task scheduling

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-1484 Framework should not sort the input splits

          • Major - Major loss of function.
          • Open
          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-19480 Implement and Incorporate MAPREDUCE-207

          • Major - Major loss of function.
          • Open
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5887 Move split creation from submission client to MRAppMaster

          • Major - Major loss of function.
          • Resolved
          is required by

          New Feature - A new feature of the product, which has yet to be developed. YARN-2332 Create REST interface for app submission

          • Major - Major loss of function.
          • Open

          Activity

            People

              jira.shegalov Gera Shegalov
              philip Philip Martin
              Votes:
              3 Vote for this issue
              Watchers:
              37 Start watching this issue

              Dates

                Created:
                Updated: