Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2434

Storm spout is not reading/emitting data in storm cluster mode (version 1.0.0)

    XMLWordPrintableJSON

Details

    • Question
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.0.0
    • None
    • storm-kafka
    • None
    • ubuntu

    Description

      I am using apache storm 1.0.0 both in local as well as cluster mode. For the spout, I am reading the data from kafka topic (I am using kafka 2.11-0.8.2.1). Spout is reading the data from kafka topic and also emitting the data when I am using storm in local mode but the storm spout is not emitting any data when I am running storm in cluster mode.

      My topology implementation for reading kafka data is as follow:

      brokerHosts = new ZkHosts(kafkaZookeeper);
      SpoutConfig kafkaConfig = new SpoutConfig(brokerHosts, kafkaTopicIn, "", "storm");
      kafkaConfig.scheme = new SchemeAsMultiScheme(new StringScheme());
      TopologyBuilder builder = new TopologyBuilder();
      builder.setSpout("spout", new KafkaSpout(kafkaConfig), 2);

      My storm configuration file:
      storm.zookeeper.servers:

      • "localhost"
        storm.zookeeper.port: 2181
        nimbus.seeds: ["localhost"]

      storm.local.dir: "/tmp/storm"

      I am also not getting any error while submitting Storm topology in cluster mode.

      Any idea why topology spout is not emitting any data in cluster mode ??
      Any help would be greatly appreciated.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ahmad_iit Minhaj Ahmad
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: