Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15406 Structured streaming support for consuming from Kafka
  3. SPARK-17343

Prerequisites for Kafka 0.8 support in Structured Streaming

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Structured Streaming
    • None

    Description

      This issue covers any API changes, refactoring, and utility classes/methods that are necessary to make it possible to implement support for Kafka 0.8 sources and sinks in Structured Streaming.

      From a quick glance, it looks like some refactoring of the existing state storage mechanism in the Kafka 0.8 DStream may suffice. But there might be some additional groundwork in other areas.

      Attachments

        Activity

          People

            Unassigned Unassigned
            freiss Frederick Reiss
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: