Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
Spark-2.1.0
-
Important
Description
The new multi topic support API added with BAHIR-89, when used in pyspark, does not return a Dstream of <topic,message> tuples.
Example:
In pyspark, when creating a Dstream using the new API ( mqttstream = MQTTUtils.createPairedStream(ssc, brokerUrl, topics) ) the expected contents of mqttstream should be a collections of tuples:
(topic,message) , (topic,message) , (topic,message) , ...
Instead, the current content is a flattened list:
topic, message, topic, message, topic, message, ...
that is hard to use.
Attachments
Issue Links
- links to