Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11725

Enhancing Proxy Host and Port Resolution Logging in WebAppUtils

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.6
    • None
    • yarn
    • None

    Description

      The method getProxyHostsAndPortsForAmFilter is designed to retrieve proxy hosts and ports for the Application Master (AM) filter based on the YARN configuration. If the yarn.web-proxy.address parameter is not set or is empty, the method attempts to resolve the addresses using ResourceManager (RM) High Availability (HA) addresses or falls back to the RM WebApp URL without the scheme. The current implementation does not provide detailed logging, making it difficult to diagnose issues related to proxy address resolution, especially when the fallback mechanisms are triggered.
       
      Expected Behavior:
      The system should log information and warnings when the proxy address is not set or is empty, providing insight into the resolution process, including when it falls back to RM HA addresses or the RM WebApp URL. This logging would assist users in ensuring correct proxy configuration and identifying potential issues during address resolution.
       
      How-to-Fix:
      We propose adding log statements that will expose the resolution process of proxy addresses, including the fallback mechanisms when the yarn.web-proxy.address parameter is not set or is empty.

      Attachments

        1. WebAppUtilsTestGetProxyHostAndPortForAmFilter.java
          0.9 kB
          LoggingResearch
        2. original-vs-log-enhanced.md
          5 kB
          LoggingResearch

        Activity

          People

            Unassigned Unassigned
            loggingresearch LoggingResearch
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: