Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-26502

Multiple component leader election has different close/stop behavior

    XMLWordPrintableJSON

Details

    Description

      The new multi component leader election driver behaves different when the service is closed.

      The ZooKeeperLeaderElectionDriver#close method closes the Zookeeper connection. In contrast, the MultipleComponentLeaderElectionDriverAdapter#close (also a LeaderElectionDriver object) only unregisters the event handler. It relies on the ZooKeeperMultipleComponentLeaderElectionDriver#close method to close the Zookeeper connection. Currently this method is only called when the HighAvailabilityServices are stopped. This difference in behavior means that previously enabled tests are not working anymore FLINK-25235.

      Together with dmvk, I propose that we align the behavior of the MultipleComponentLeaderElectionDriverAdapter to the existing behavior. We can do so by closing the Zookeeper connection once all components that are part of the multiple component leader election have stopped.

      PS: I use ZooKeeper here as an example, the same can be said about Kubernetes as well.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              nsemmler Niklas Semmler
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: