Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-666 [Umbrella] Support rolling upgrades in YARN
  3. YARN-668

TokenIdentifier serialization should consider Unknown fields

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 2.6.0
    • None
    • None
    • Incompatible change, Reviewed

    Description

      This would allow changing of the TokenIdentifier between versions. The current serialization is Writable. A simple way to achieve this would be to have a Proto object as the payload for TokenIdentifiers, instead of individual fields.

      TokenIdentifier continues to implement Writable to work with the RPC layer - but the payload itself is serialized using PB.

      Attachments

        1. YARN-668-v9.patch
          73 kB
          Junping Du
        2. YARN-668-v8.patch
          72 kB
          Junping Du
        3. YARN-668-v7.patch
          73 kB
          Junping Du
        4. YARN-668-v6.patch
          71 kB
          Junping Du
        5. YARN-668-v5.patch
          68 kB
          Junping Du
        6. YARN-668-v4.patch
          97 kB
          Junping Du
        7. YARN-668-v3.patch
          97 kB
          Junping Du
        8. YARN-668-v2.patch
          95 kB
          Junping Du
        9. YARN-668-v10.patch
          71 kB
          Junping Du
        10. YARN-668-demo.patch
          7 kB
          Junping Du
        11. YARN-668.patch
          83 kB
          Junping Du

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-2558 Updating ContainerTokenIdentifier#read/write to use ContainerId#getContainerId

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          breaks

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6355 2.5 client cannot communicate with 2.5 job on 2.6 cluster

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-8310 Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. YARN-2593 Many tests get failed on trunk

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-2615 ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              junping_du Junping Du
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: