Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
While working on HIVE-7665, I noticed that spark local cluster will crash entire JVM on any dependency version mismatch, either due to native code linkage errors if you are unlucky, or gracefully (see spark's ExecutorUncaughtExceptionHandler.scala) most of the time.
To debug those issues, it would be nice to log a thread-dump upon normal JVM exits by spark by ExecutorUncaughtExceptionHandler, as its unexpected by Hive's test framework. One way is to add a shutdownHook that does this.
Attachments
Issue Links
- is part of
-
HIVE-7665 Create TestSparkCliDriver to run test in spark local mode [Spark Branch]
- Resolved