Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1386

NodeManager mistakenly loses resources and relocalizes them

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.10, 2.2.0
    • 0.23.10, 2.3.0
    • nodemanager
    • None

    Description

      When a local resource that should already be present is requested again, the nodemanager checks to see if it still present. However the method it uses to check for presence is via File.exists() as the user of the nodemanager process. If the resource was a private resource localized for another user, it will be localized to a location that is not accessible by the nodemanager user. Therefore File.exists() returns false, the nodemanager mistakenly believes the resource is no longer available, and it proceeds to localize it over and over.

      Attachments

        1. YARN-1386.patch
          5 kB
          Jason Darrell Lowe
        2. YARN-1386.patch
          5 kB
          Jason Darrell Lowe

        Activity

          People

            jlowe Jason Darrell Lowe
            jlowe Jason Darrell Lowe
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: