Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4349

Support CallerContext in YARN

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      More details about CallerContext please refer to description of HDFS-9184.

      From YARN's perspective, we should make following changes:

      • RMAuditLogger logs application's caller context when application submit by user
      • Add caller context to application's data in ATS along with application creation event

      From MR's perspective:

      • Set AppMaster container's context to YARN's application Id
      • Set Mapper/Reducer containers' context to task attempt id

      Protocol and RPC changes are done in HDFS-9184.

      Attachments

        1. YARN-4349.1.patch
          61 kB
          Wangda Tan
        2. YARN-4349.2.patch
          62 kB
          Wangda Tan
        3. YARN-4349.3.patch
          62 kB
          Wangda Tan
        4. YARN-4349.4.patch
          63 kB
          Wangda Tan

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. HDFS-9184 Logging HDFS operation's caller context into audit logs

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-16809 Support setting CallerContext on YARN deployments

          • Not a Priority -
          • Open

          Activity

            People

              leftnoteasy Wangda Tan
              leftnoteasy Wangda Tan
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: