Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-3202

Include offset information to spout metrics and remove storm-kafka-monitor

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Abandoned
    • 2.0.0
    • None
    • None
    • None

    Description

      To provide offset information on Kafka spout (old and new), we have storm-kafka-monitor module which is being run by UI (shell). This approach requires UI doing too many things - basically UI process does most of things via interacting with Nimbus - and also running external shell process in UI process per opening topology page doesn't look right.

      We could just let Spout include offset information into spout metric, and let UI leverage the information. I have been thinking about this approach but forgot about addressing it while thinking about generalizing the format. Now I think we don't have to put too much effort to generalize format, because Kafka spout is used mainly.

       

      Attachments

        Issue Links

          Activity

            People

              srdo Stig Rohde Døssing
              kabhwan Jungtaek Lim
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: