Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4477

Secondary namenode may retain old tokens

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0, 2.0.0-alpha, 3.0.0-alpha1
    • 2.1.0-beta, 0.23.8
    • security
    • None
    • Reviewed

    Description

      Upon inspection of a fsimage created by a secondary namenode, we've discovered it contains very old tokens. These are probably the ones that were not explicitly canceled. It may be related to the optimization done to avoid loading fsimage from scratch every time checkpointing.

      Attachments

        1. HDFS-4477.branch-23.patch
          9 kB
          Daryn Sharp
        2. HDFS-4477.patch
          9 kB
          Daryn Sharp
        3. HDFS-4477.patch
          9 kB
          Daryn Sharp
        4. HDFS-4477.patch
          5 kB
          Daryn Sharp
        5. HDFS-4477.patch
          9 kB
          Daryn Sharp
        6. HDFS-4477.patch
          3 kB
          Daryn Sharp

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HDFS-13112 Token expiration edits may cause log corruption or deadlock

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4690 Namenode exits if entering safemode while secret manager is edit logging

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-9341 Secret Managers should allow explicit purging of tokens and secret keys

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              daryn Daryn Sharp
              kihwal Kihwal Lee
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: