Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3561 [Umbrella ticket] Performance issues in YARN+MR
  3. MAPREDUCE-3810

MR AM's ContainerAllocator is assigning the allocated containers very slowly

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mrv2, performance
    • None

    Description

      This is mostly due to logging and other not-so-cheap operations we are doing as part of the AM->RM heartbeat cycle.

      Attachments

        1. MAPREDUCE-3810-20120205.txt
          44 kB
          Vinod Kumar Vavilapalli

        Issue Links

          blocks

          Sub-task - The sub-task of the issue MAPREDUCE-3524 Scan benchmark is more than 1.5x slower in 0.23

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              vinodkv Vinod Kumar Vavilapalli
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: