Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4609

KTable/KTable join followed by groupBy and aggregate/count can result in duplicated results

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.10.1.1, 0.10.2.0
    • None
    • streams

    Description

      When caching is enabled, KTable/KTable joins can result in duplicate values being emitted. This will occur if there were updates to the same key in both tables. Each table is flushed independently, and each table will trigger the join, so you get two results for the same key.
      If we subsequently perform a groupBy and then aggregate operation we will now process these duplicates resulting in incorrect aggregated values. For example count will be double the value it should be.

      Attachments

        Activity

          People

            Unassigned Unassigned
            damianguy Damian Guy
            Votes:
            1 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated: