Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15184

SparkSQL Scan operation doesn't work on kerberos cluster

    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      Before this patch, users of the spark HBaseContext would fail due to lack of privilege exceptions.

      Note:
      * It is preferred to have spark in spark-on-yarn mode if Kerberos is used.
      * This is orthogonal to issues with a kerberized spark cluster via InputFormats.

       
      Show
      Before this patch, users of the spark HBaseContext would fail due to lack of privilege exceptions. Note: * It is preferred to have spark in spark-on-yarn mode if Kerberos is used. * This is orthogonal to issues with a kerberized spark cluster via InputFormats.  

    Description

      I was using the HBase Spark Module at a client with Kerberos and I ran into an issue with the Scan.

      I made a fix for the client but we need to put it back into HBase. I will attach my solution, but it has a major problem. I had to over ride a protected class in spark. I will need help to decover a better approach

      Attachments

        1. HBaseSparkModule.zip
          89 kB
          Theodore michael Malaska
        2. HBASE-15184.1.patch
          8 kB
          Theodore michael Malaska

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. HBASE-14160 backport hbase-spark module to branch-1 and branch-2

          • Major - Major loss of function.
          • Closed
          links to

          Web Link review board

          Activity

            People

              ted.m Theodore michael Malaska
              ted.m Theodore michael Malaska
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: