Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-15337

Disable *-subscription-store-changelog topic creation for foreign key join in Kafka Streams

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • streams

    Description

      I recently asked a question on stackoverflow where mjsax commented to raise a ticket for this.

       

      Requirement:

      When we do foreign key join in Kafka streams, it creates 3 state stores (as given on the confluent page) :

      The three state stores involved are:

      1. left-STATE-STORE-0000000000: The left-hand-side KTable store.
      2. right-STATE-STORE-0000000003: The left-hand-side KTable store.
      3. myjoin-subscription-store: The subscription store for the join. This is the new data structure discussed above. Regardless of the operation name, this store is always suffixed -subscription-store. Note for your capacity planning that this store will also have a corresponding changelog, called myjoin-subscription-store-changelog.

      Can we have an additional option to disable this myjoin-subscription-store-changelog topic creation?

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            rohan Rohan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: