Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13478

Fetching delegation tokens for Hive fails when using proxy users

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.6.0, 2.0.0
    • 1.6.4, 2.0.0
    • Spark Core, YARN
    • None

    Description

      If you use spark-submit's proxy user support, the code that fetches delegation tokens for the Hive Metastore fails. It seems like the Hive library tries to connect to the Metastore as the proxy user, and it doesn't have a Kerberos TGT for that user, so it fails.

      I don't know whether the same issue exists in the HBase code, but I'll make a similar change so that both behave similarly.

      Attachments

        Issue Links

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              2 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: