Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-25932

wrong config file name in spark service advisor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0
    • trunk
    • ambari-server
    • None

    Description

      When using Spark 3.x, the "spark-defaults.conf" file is required to configure the Spark cluster, instead of "spark-default.xml" or "spark2-default.xml". In Ambari 2.8, all configurations for the Spark service are in the "spark-defaults.conf" file. However, the service advisor is still based on Spark 2, so the default Spark configuration file needs to be changed from "spark2-default" to "spark-default".

      In addition, in Ambari 2.8, the Spark 3 Thrift Server also uses "spark-defaults.conf" at startup, so the "spark2-thrift-sparkconf" configuration in the advisor needs to be deprecated.

      Attachments

        Issue Links

          Activity

            People

              jialiang Jialiang Cai
              jialiang Jialiang Cai
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m