Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.0.0
-
None
-
None
Description
Currently Spark hasn't supported Hadoop3 since it's blocked by Hive to support Hadoop3 so Hive takes the workaround to get HoS tests to pass (see TestJdbcWithLocalClusterSpark and TestMultiSessionsHS2WithLocalClusterSpark).
SPARK-18673 is to enable the support of Hadoop3. After the work is done, we should upgrade Spark version dependency and remove such hack in these two tests.