Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4112

Add hdfs keberos token delegation in Spark to support HBase and MR use different HDFS clusters

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • v3.0.0-beta
    • None
    • None

    Description

      Currently the SparkExecutable only delegate the token for yarn hdfs cluster, not for the hdfs cluster used by the HBase cluster.

      The spark job of Convert Cuboid Data to HFile will failed for kerberos issue.

       

      Attachments

        Issue Links

          Activity

            People

              liushaohui Shaohui Liu
              liushaohui Shaohui Liu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: