Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5481

Enable uber jobs to have multiple reducers

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.3.0, 3.0.0-alpha1
    • 2.3.0
    • mrv2, test
    • None
    • Reviewed

    Description

      TestUberAM has been timing out on trunk for some time now and surefire then fails the build. I'm not able to reproduce it locally, but the Jenkins builds have been seeing it fairly consistently. See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1529/console

      This is caused by changes made in MAPREDUCE-434 breaking Uber AMs. The easiest fix is to make similar changes in Uber AMs to those in MAPREDUCE-434 to allow multiple reducers.

      Attachments

        1. MAPREDUCE-5481.patch
          15 kB
          Jonathan Turner Eagles
        2. MAPREDUCE-5481.patch
          15 kB
          Sandy Ryza
        3. MAPREDUCE-5481-1.patch
          13 kB
          Sandy Ryza
        4. syslog
          728 kB
          Xuan Gong

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5952 LocalContainerLauncher#renameMapOutputForReduce incorrectly assumes a single dir for mapOutIndex

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-434 LocalJobRunner limited to single reducer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5502 History link in resource manager is broken for KILLED jobs

          • Major - Major loss of function.
          • Open

          Activity

            People

              sandyr Sandy Ryza
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: