Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-28241

beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.3
    • None
    • Beeline
    • None

    Description

      24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Current authMethod = KERBEROS

      24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Not setting UGI conf as passed-in authMethod of kerberos = current.

      24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: PrivilegedAction [as: hive/mk2.example.com@JIO.COM (auth:KERBEROS)][action: org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client$1@61a1ea2c]

      java.lang.Exception: null

              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) [hadoop-common-3.3.6.jar:?]

              at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client.createClientTransport(HadoopThriftAuthBridge.java:234) [hive-exec-3.1.3.jar:3.1.3]

              at org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:56) [hive-service-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:601) [hive-jdbc-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:341) [hive-jdbc-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:228) [hive-jdbc-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3.jar:3.1.3]

              at java.sql.DriverManager.getConnection(DriverManager.java:664) [?:1.8.0_371]

              at java.sql.DriverManager.getConnection(DriverManager.java:208) [?:1.8.0_371]

              at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.Commands.connect(Commands.java:1641) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.Commands.connect(Commands.java:1536) [hive-beeline-3.1.3.jar:3.1.3]

              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]

              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]

              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]

              at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]

              at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) [hive-beeline-3.1.3.jar:3.1.3]

              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]

              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]

              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]

              at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]

              at org.apache.hadoop.util.RunJar.run(RunJar.java:328) [hadoop-common-3.3.6.jar:?]

              at org.apache.hadoop.util.RunJar.main(RunJar.java:241) [hadoop-common-3.3.6.jar:?]

      24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: PrivilegedAction [as: hive/mk2.example.com@JIO.COM (auth:KERBEROS)][action: org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport$1@149debbb]

      java.lang.Exception: null

              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) [hadoop-common-3.3.6.jar:?]

              at org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport.open(TUGIAssumingTransport.java:48) [hive-exec-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:343) [hive-jdbc-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:228) [hive-jdbc-3.1.3.jar:3.1.3]

              at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3.jar:3.1.3]

              at java.sql.DriverManager.getConnection(DriverManager.java:664) [?:1.8.0_371]

              at java.sql.DriverManager.getConnection(DriverManager.java:208) [?:1.8.0_371]

              at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.Commands.connect(Commands.java:1641) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.Commands.connect(Commands.java:1536) [hive-beeline-3.1.3.jar:3.1.3]

              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]

              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]

              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]

              at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]

              at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) [hive-beeline-3.1.3.jar:3.1.3]

              at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) [hive-beeline-3.1.3.jar:3.1.3]

              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]

              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]

              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]

              at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]

              at org.apache.hadoop.util.RunJar.run(RunJar.java:328) [hadoop-common-3.3.6.jar:?]

              at org.apache.hadoop.util.RunJar.main(RunJar.java:241) [hadoop-common-3.3.6.jar:?]

      24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: opening transport org.apache.thrift.transport.TSaslClientTransport@25cd49a4

      24/04/30 12:52:03 [main-EventThread]: INFO zookeeper.ClientCnxn: EventThread shut down

      24/04/30 12:52:03 [main]: DEBUG transport.TSaslClientTransport: Sending mechanism name GSSAPI and initial response of length 621

      24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: CLIENT: Writing message with status START and payload length 6

      24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: CLIENT: Writing message with status OK and payload length 621

      24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: CLIENT: Start message handled

      24/04/30 12:52:03 [main]: WARN jdbc.HiveConnection: Failed to connect to mk3.example.com:10000

      24/04/30 12:52:03 [main]: INFO imps.CuratorFrameworkImpl: Starting

      24/04/30 12:52:03 [main]: DEBUG curator.CuratorZookeeperClient: Starting

      24/04/30 12:52:03 [main]: DEBUG curator.ConnectionState: Starting

      24/04/30 12:52:03 [main]: DEBUG curator.ConnectionState: reset

      24/04/30 12:52:03 [main]: INFO zookeeper.ZooKeeper: Initiating client connection, connectString=10.161.171.36:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@e9dc4d0

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: INFO zookeeper.ClientCnxn: Opening socket connection to server 10.161.171.36/10.161.171.36:2181. Will not attempt to authenticate using SASL (unknown error)

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: INFO zookeeper.ClientCnxn: Socket connection established to 10.161.171.36/10.161.171.36:2181, initiating session

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: Session establishment request sent on 10.161.171.36/10.161.171.36:2181

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: INFO zookeeper.ClientCnxn: Session establishment complete on server 10.161.171.36/10.161.171.36:2181, sessionid = 0x300001b577d001d, negotiated timeout = 40000

      24/04/30 12:52:03 [main-EventThread]: INFO state.ConnectionStateManager: State change: CONNECTED

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x300001b577d001d, packet:: clientPath:null serverPath:null finished:false header:: 1,12  replyHeader:: 1,12884902102,0  request:: '/hiveserver2,F  response:: v{'serverUri=mk5.example.com:10000;version=3.1.3;sequence=0000000004,'serverUri=mk1.example.com:10000;version=3.1.3;sequence=0000000006,'serverUri=mk3.example.com:10000;version=3.1.3;sequence=0000000005},s{8589935031,8589935031,1714458097538,1714458097538,0,13,0,0,13,3,12884902062}

      24/04/30 12:52:03 [main]: DEBUG imps.CuratorFrameworkImpl: Closing

      24/04/30 12:52:03 [Curator-Framework-0]: INFO imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting

      24/04/30 12:52:03 [main]: DEBUG curator.CuratorZookeeperClient: Closing

      24/04/30 12:52:03 [main]: DEBUG curator.ConnectionState: Closing

      24/04/30 12:52:03 [main]: DEBUG zookeeper.ZooKeeper: Closing session: 0x300001b577d001d

      24/04/30 12:52:03 [main]: DEBUG zookeeper.ClientCnxn: Closing client for session: 0x300001b577d001d

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x300001b577d001d, packet:: clientPath:null serverPath:null finished:false header:: 2,-11  replyHeader:: 2,12884902103,0  request:: null response:: null

      24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: An exception was thrown while closing send thread for session 0x300001b577d001d : Unable to read additional data from server sessionid 0x300001b577d001d, likely server has closed socket

      24/04/30 12:52:03 [main]: DEBUG zookeeper.ClientCnxn: Disconnecting client for session: 0x300001b577d001d

      24/04/30 12:52:03 [main]: INFO zookeeper.ZooKeeper: Session: 0x300001b577d001d closed

      24/04/30 12:52:03 [main]: ERROR jdbc.Utils: Unable to read HiveServer2 configs from ZooKeeper

      24/04/30 12:52:03 [main-EventThread]: INFO zookeeper.ClientCnxn: EventThread shut down

      Unknown HS2 problem when communicating with Thrift server.

      Error: Could not open client transport for any of the Server URI's in ZooKeeper: Peer indicated failure: Unsupported mechanism type GSSAPI (state=08S01,code=0)

      beeline>

      Attachments

        Activity

          People

            Unassigned Unassigned
            manoj.kushwaha manoj kumar
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: