Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14048 The Next Generation of the Consumer Rebalance Protocol
  3. KAFKA-15574

Update states and transitions for membership manager state machine

    XMLWordPrintableJSON

Details

    Description

      This task is to update the state machine so that it correctly acts as the glue between the heartbeat request manager and the assignment reconciler.

      The state machine will transition from one state to another as a response to heartbeats, callback completion, errors, unsubscribing, and other external events. A given transition may kick off one or more actions that are implemented outside of the state machine.

      Steps:

      1. Update the set of states in the code as defined in the diagrams on the wiki
      2. Ensure the correct state transitions are performed as responses to external input
      3. Define any actions that should be taken as a result of the above transitions (commit before revoking partitions, stop fetching from partitions being revoked, allow members that do not join a group)

      Attachments

        Issue Links

          incorporates

          Sub-task - The sub-task of the issue KAFKA-15539 Client should stop fetching while partitions being revoked

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue KAFKA-15573 Implement auto-commit on partition assignment revocation

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue KAFKA-15592 Member does not need to always try to join a group when a groupId is configured

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Sub-task - The sub-task of the issue KAFKA-15543 Send HB request right after reconciliation completes

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is related to

          Sub-task - The sub-task of the issue KAFKA-15573 Implement auto-commit on partition assignment revocation

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue KAFKA-15276 Implement event plumbing for ConsumerRebalanceListener callbacks

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Sub-task - The sub-task of the issue KAFKA-15832 Trigger client reconciliation based on manager poll

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #14690

          Web Link GitHub Pull Request #14857

          Activity

            People

              lianetm Lianet Magrans
              kirktrue Kirk True
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: