Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17999

Add getPreferredLocations for KafkaSourceRDD

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.0.2, 2.1.0
    • Structured Streaming
    • None

    Description

      The newly implemented Structured Streaming KafkaSource did calculate the preferred locations for each topic partition, but didn't offer this information through RDD's getPreferredLocations method. So here propose to add this method in KafkaSourceRDD.

      Attachments

        Activity

          People

            jerryshao Saisai Shao
            jerryshao Saisai Shao
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: