Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1471

NPE in AsyncKuduClient from Spark

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.0
    • client, spark
    • None

    Description

      I'm testing out the Spark support on a ~70 node cluster (240 executors). I hit this NPE:

      scala> kuduDataFrame.count()
      16/05/26 18:36:31 WARN scheduler.TaskSetManager: Lost task 220.0 in stage 4.0 (TID 1417, e1313.halxg.cloudera.com): java.lang.NullPointerException
      	at org.kududb.client.AsyncKuduClient$RemoteTablet.addTabletClient(AsyncKuduClient.java:1929)
      	at org.kududb.client.AsyncKuduClient$RemoteTablet.refreshTabletClients(AsyncKuduClient.java:1897)
      	at org.kududb.client.AsyncKuduClient.discoverTablets(AsyncKuduClient.java:1309)
      	at org.kududb.client.AsyncKuduClient$MasterLookupCB.call(AsyncKuduClient.java:1232)
      	at org.kududb.client.AsyncKuduClient$MasterLookupCB.call(AsyncKuduClient.java:1224)
      	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1278)
      	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1257)
      	at com.stumbleupon.async.Deferred.callback(Deferred.java:1005)
      	at org.kududb.client.KuduRpc.handleCallback(KuduRpc.java:194)
      	at org.kududb.client.KuduRpc.callback(KuduRpc.java:207)
      	at org.kududb.client.TabletClient.decode(TabletClient.java:477)
      	at org.kududb.client.TabletClient.decode(TabletClient.java:83)
      

      Attachments

        Issue Links

          Activity

            People

              malaskat Ted Malaska
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: