Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2730

DefaultContainerExecutor runs only one localizer at a time

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.4.0
    • 2.6.0
    • None
    • None
    • Reviewed

    Description

      We are seeing that when one of the localizerRunner stuck, the rest of the localizerRunners are blocked. We should remove the synchronized modifier.
      The synchronized modifier appears to have been added by https://issues.apache.org/jira/browse/MAPREDUCE-3537
      It could be removed if Localizer doesn't depend on current directory

      Attachments

        1. YARN-2730.v1.patch
          10 kB
          Siqi Li
        2. YARN-2730.v2.patch
          2 kB
          Siqi Li
        3. YARN-2730.v3.patch
          3 kB
          Siqi Li

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-2714 Localizer thread might stuck if NM is OOM

          • Major - Major loss of function.
          • Open

          Activity

            People

              l201514 Siqi Li
              l201514 Siqi Li
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: