Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11724

Exposing Configuration Handling for Proxy Host and Port in WebAppUtils

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.6
    • None
    • yarn
    • None
    • Version: ** 3.3.6
      Location: hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/util/WebAppUtils.java, in the getProxyHostAndPort method, lines 209-219.

    Description

      The method getProxyHostAndPort is responsible for retrieving the proxy host and port from the YARN configuration. If the parameter yarn.web-proxy.address is not set or is empty, the system falls back to resolving the ResourceManager (RM) Web App URL without the scheme. However, this fallback mechanism can cause issues if the proxy settings are expected but not properly configured. The current implementation does not provide any logs or warnings when this fallback occurs, leading to potential misconfigurations going unnoticed.
       
      Expected Behavior:
      The system should log a warning when the yarn.web-proxy.address parameter is not set or is empty, informing the user that the system is falling back to the resolved RM Web App URL without the scheme. This log would help users identify and correct potential misconfigurations in their YARN proxy settings.
       
      How-to-Fix:
      We propose adding log statements to expose the handling of unset or empty configuration values when retrieving the proxy host and port.

      Attachments

        1. WebAppUtilsTest.java
          0.8 kB
          LoggingResearch
        2. original-vs-log-enhanced.md
          2 kB
          LoggingResearch

        Activity

          People

            Unassigned Unassigned
            loggingresearch LoggingResearch
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: