Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11722

Exposing Configuration Handling for Log Retention Size in LogAggregationFileController

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.6
    • None
    • yarn
    • None

    Description

      When configuring the log aggregation retention size using yarn.nodemanager.log-aggregation.num-log-files-per-app, users may mistakenly set the value to a non-positive integer, expecting it to work without issues. However, this misconfiguration is silently corrected by defaulting to a predefined retention size of 30. This silent handling can lead to confusion as there is no system output indicating the correction, leaving users unaware of the actual configuration being applied.
       
      Expected Behavior:
      The system should provide log output to inform users about the applied default retention size when an invalid value is configured.
       
      How-to-Fix:
      We propose exposing the handling of invalid retention size values by adding logging.

      Attachments

        1. TestLogAggregationFileControllerFactory.java
          0.8 kB
          LoggingResearch
        2. original-vs-log-enhanced.md
          3 kB
          LoggingResearch

        Activity

          People

            Unassigned Unassigned
            loggingresearch LoggingResearch
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: