Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10743

Add a policy for not aggregating for containers which are killed because exceeding container log size limit.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0, 3.3.1
    • 3.4.0, 3.3.1
    • nodemanager
    • None

    Description

      Since YARN-10471 supported container log size limited for kill.

      We'd better to add a policy that can not aggregated for those containers, so that to reduce the pressure of HDFS etc.

      cc epayne Jim_Brennan ebadger

      Attachments

        1. YARN-10743.001.patch
          6 kB
          Qi Zhu
        2. image-2021-04-20-10-41-01-057.png
          86 kB
          Qi Zhu
        3. YARN-10743.002.patch
          5 kB
          Qi Zhu
        4. YARN-10743.003.patch
          6 kB
          Qi Zhu

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10471 Prevent logs for any container from becoming larger than a configurable size.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              zhuqi Qi Zhu
              zhuqi Qi Zhu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: