Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3112

SparkConfigrationService overwrites properties provided via --properties-file option in SparkAction

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.0.0b1
    • None
    • None

    Description

      SparkConfigurationService injects the config values as --conf to SparkSubmit. This will overwrite propties provided in the --properies-file option which is not the expected behavior.

      Attachments

        1. OOZIE-3112.01.patch
          13 kB
          Gézapeti
        2. OOZIE-3112.02.patch
          16 kB
          Gézapeti
        3. OOZIE-3112.03.patch
          114 kB
          Gézapeti
        4. OOZIE-3112.04.patch
          116 kB
          Gézapeti
        5. OOZIE-3112.05.patch
          20 kB
          Gézapeti
        6. OOZIE-3112.06.patch
          21 kB
          Gézapeti
        7. OOZIE-3112.07.patch
          21 kB
          Gézapeti
        8. OOZIE-3112.08.patch
          22 kB
          Gézapeti
        9. OOZIE-3112.09.patch
          23 kB
          Gézapeti

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-3228 [Spark action] Can't load properties from spark-defaults.conf

          • Major - Major loss of function.
          • Closed
          links to

          Web Link ReviewBoard

          Activity

            People

              gezapeti Gézapeti
              gezapeti Gézapeti
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: