Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3644

Node manager shuts down if unable to connect with RM

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • nodemanager
    • None

    Description

      When NM is unable to connect to RM, NM shuts itself down.

                } catch (ConnectException e) {
            //catch and throw the exception if tried MAX wait time to connect RM
            dispatcher.getEventHandler().handle(
                new NodeManagerEvent(NodeManagerEventType.SHUTDOWN));
            throw new YarnRuntimeException(e);

      In large clusters, if RM is down for maintenance for longer period, all the NMs shuts themselves down, requiring additional work to bring up the NMs.

      Setting the yarn.resourcemanager.connect.wait-ms to -1 has other side effects, where non connection failures are being retried infinitely by all YarnClients (via RMProxy).

      Attachments

        1. YARN-3644.003.patch
          10 kB
          Raju Bairishetti
        2. YARN-3644.002.patch
          9 kB
          Raju Bairishetti
        3. YARN-3644.001.patch
          9 kB
          Raju Bairishetti
        4. YARN-3644.001.patch
          9 kB
          Raju Bairishetti
        5. YARN-3644.patch
          10 kB
          Raju Bairishetti

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-196 Nodemanager should be more robust in handling connection failure to ResourceManager when a cluster is started

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. YARN-479 NM retry behavior for connection to RM should be similar for lost heartbeats

          • Major - Major loss of function.
          • Closed

          Wish - General wishlist item. YARN-3668 Long run service shouldn't be killed even if Yarn crashed

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-3847 Refactor TestNodeStatusUpdater

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. YARN-3646 Applications are getting stuck some times in case of retry policy forever

          • Major - Major loss of function.
          • Closed

          Activity

            People

              raju.bairishetti Raju Bairishetti
              sriksun Srikanth Sundarrajan
              Votes:
              1 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated: