Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-24038

DispatcherResourceManagerComponent fails to deregister application if no leading ResourceManager

    XMLWordPrintableJSON

Details

    • Hide
      A new multiple component leader election service was implemented that only runs a single leader election per Flink process. If this should cause any problems, then you can set `high-availability.use-old-ha-services: true` in the `flink-conf.yaml` to use the old high availability services.
      Show
      A new multiple component leader election service was implemented that only runs a single leader election per Flink process. If this should cause any problems, then you can set `high-availability.use-old-ha-services: true` in the `flink-conf.yaml` to use the old high availability services.

    Description

      With FLINK-21667 we introduced a change that can cause the DispatcherResourceManagerComponent to fail when trying to stop the application. The problem is that the DispatcherResourceManagerComponent needs a leading ResourceManager to successfully execute the stop/deregister application call. If this is not the case, then it will fail fatally. In the case of multiple standby JobManager processes it can happen that the leading ResourceManager runs somewhere else.

      I do see two possible solutions:

      1. Run the leader election process for the whole JobManager process
      2. Move the registration/deregistration of the application out of the ResourceManager so that it can be executed w/o a leader

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. FLINK-23946 Application mode fails fatally when being shut down

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Technical Debt - FLINK-25235 Re-enable ZooKeeperLeaderElectionITCase#testJobExecutionOnClusterWithLeaderChange

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          causes

          Bug - A problem which impairs or prevents the functions of the product. FLINK-26630 EmbeddedHaServices is not made for recovery on a single instance

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. FLINK-25981 ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers failed

          • Major - Major loss of function.
          • Resolved
          is caused by

          Bug - A problem which impairs or prevents the functions of the product. FLINK-21667 Standby RM might remove resources from Kubernetes

          • Major - Major loss of function.
          • Closed
          is related to

          Sub-task - The sub-task of the issue FLINK-25432 Introduce common interfaces for cleaning up local and global job data

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-33598 Watch HA configmap via name instead of lables to reduce pressure on APIserver

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-25500 ZooKeeperLeaderElectionITCase.testJobExecutionOnClusterWithLeaderChange failed on azure

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Reopened

          Bug - A problem which impairs or prevents the functions of the product. FLINK-25847 KubernetesHighAvailabilityRecoverFromSavepointITCase. testRecoverFromSavepoint failed on azure

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-27358 Kubernetes operator throws NPE when testing with Flink 1.15

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-25393 Make ConfigMap Name for Leader Election Configurable

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Technical Debt - FLINK-25806 Remove legacy high availability services

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          links to

          Web Link GitHub Pull Request #17485

          mentioned in

          Page Loading...

          Activity

            People

              trohrmann Till Rohrmann
              trohrmann Till Rohrmann
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: