Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3561 [Umbrella ticket] Performance issues in YARN+MR
  3. MAPREDUCE-3616

Thread pool for launching containers in MR AM not expanding as expected

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.1
    • 0.23.1
    • mr-am, mrv2, performance
    • None
    • Reviewed

    Description

      Found this while running some benchmarks on 350 nodes. The thread pool stays at 60 for a long time and only expands to 350 towards the fag end of the job.

      Attachments

        1. MAPREDUCE-3616-20120105.txt
          26 kB
          Vinod Kumar Vavilapalli

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-3389 MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              vinodkv Vinod Kumar Vavilapalli
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: