Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21232

Kerberos delegation token framework

    XMLWordPrintableJSON

Details

    Description

      Proper delegation token handling is completely missing from Flink. This jira is an umbrella to track this effort.
      Please see the attached FLIP and discussion threads for more details.

      Email dicussion threads:

      https://lists.apache.org/thread.html/rbedb6e769358a10c6426c4c42b3b51cdbed48a3b6537e4ebde912bc0%40%3Cdev.flink.apache.org%3E
      https://lists.apache.org/thread.html/r20d4be431ff2f6faff94129b5321a047fcbb0c71c8e092504cd91183%40%3Cdev.flink.apache.org%3E
      https://lists.apache.org/thread/cvwknd5fhohj0wfv8mfwn70jwpjvxrjj

       

      Attachments

        Issue Links

          Blocked

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-20714 Hive delegation token is not obtained when using `kinit` to submit Yarn per-job

          • Not a Priority -
          • Open
          links to

          Web Link FLIP-211

          Web Link GitHub Pull Request #14841

          1.
          		 Add pluggable delegation token manager Sub-task Closed Gabor Somogyi
          2.
          		 Add periodic kerberos relogin to DelegationTokenManager Sub-task Closed Gabor Somogyi
          3.
          		 Upgrade mockito to a version where static function mocking is possible Sub-task Closed Gabor Somogyi
          4.
          		 Add periodic kerberos delegation token obtain possibility to DelegationTokenManager Sub-task Closed Gabor Somogyi
          5.
          		 security.kerberos.login.principal can be defined wihtout keytab which is wrong configuration Sub-task Closed Gabor Somogyi
          6.
          		 Add hadoop filesystems configuration possibility to all deployment targets Sub-task Closed Gabor Somogyi
          7.
          		 Move Hadoop FS token obtain functionality into HadoopFSDelegationTokenProvider Sub-task Closed Gabor Somogyi
          8.
          		 Make Hadoop FS token renewer configurable Sub-task Closed Gabor Somogyi
          9.
          		 KerberosDelegationTokenManager fails to load DelegationTokenProvider due to NoClassDefFoundError in various ITCases Sub-task Resolved Gabor Somogyi
          10.
          		 Move HBase token obtain functionality into HBaseDelegationTokenProvider Sub-task Closed Gabor Somogyi
          11.
          		 Propagate obtained delegation tokens to TaskManagers Sub-task Closed Gabor Somogyi
          12.
          		 Remove old delegation token framework code when new is working fine Sub-task Closed Gabor Somogyi
          13.
          		 Simplify HadoopModule Sub-task Closed Gabor Somogyi
          14.
          		 E2E test for delegation token framework Sub-task Closed Gabor Somogyi
          15.
          		 Replace old kerberos docker image used in secure e2e tests Sub-task Closed Gabor Somogyi
          16.
          		 Annotate all the public classes for the delegation token framework Sub-task Closed Gabor Somogyi
          17.
          		 Add delegation token framework documentation Sub-task Closed Gabor Somogyi

          Activity

            People

              gaborgsomogyi Gabor Somogyi
              jackwangcs jackwangcs
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: