Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33534

PipelineOptions.PARALLELISM_OVERRIDES is not picked up from jar submission request

    XMLWordPrintableJSON

Details

    Description

      PARALLELISM_OVERRIDES are currently only applied when they are part of the JobManager / Cluster configuration.

      When this config is provided as part of the JarRunRequestBody it is completely ignored and does not take effect. 

      The main reason is that the dispatcher reads this value from it's own configuration object and does not include the extra configs passed through the rest request.

      This is a blocker for supporting the autoscaler properly for FlinkSessionJobs in the autoscaler

      Attachments

        Activity

          People

            yunfengzhou Yunfeng Zhou
            gyfora Gyula Fora
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: