Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.8.0
-
None
Description
When using Spark 3.x, the "spark-defaults.conf" file is required to configure the Spark cluster, instead of "spark-default.xml" or "spark2-default.xml". In Ambari 2.8, all configurations for the Spark service are in the "spark-defaults.conf" file. However, the service advisor is still based on Spark 2, so the default Spark configuration file needs to be changed from "spark2-default" to "spark-default".
In addition, in Ambari 2.8, the Spark 3 Thrift Server also uses "spark-defaults.conf" at startup, so the "spark2-thrift-sparkconf" configuration in the advisor needs to be deprecated.
Attachments
Issue Links
- Blocked
-
AMBARI-26001 ambari2.8 release
- Open
- links to