Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1950

Change response json of "Topology Lag" REST API to keyed by spoutId, topic, partition

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.1.0
    • 2.0.0, 1.1.0
    • storm-ui
    • None

    Description

      From code review for STORM-1945, there's an idea to change JSON response of "Topology Lag" API to keyed by topic, partition number.

      https://github.com/apache/storm/pull/1541#issuecomment-230983140

      I think also make result keyed by spout id would be good.
      Here's sample JSON of output after this issue is resolved.

      {
   "spout1":{
      "spoutId":"spout1",
      "spoutType":"KAFKA",
      "spoutLagResult":{
         "topic":{
            "partition0":{
               "consumerCommittedOffset":1175610,
               "logHeadOffset":5634192,
               "lag":4458582
            },
            "partition2":{
               "consumerCommittedOffset":1175610,
               "logHeadOffset":5634192,
               "lag":4458582
            }
         },
         "topic2":{
            "partition0":{
               "consumerCommittedOffset":1175610,
               "logHeadOffset":5634192,
               "lag":4458582
            },
            "partition2":{
               "consumerCommittedOffset":1175610,
               "logHeadOffset":5634192,
               "lag":4458582
            }
         }
      }
   }
}

      Attachments

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. STORM-1959 KafkaPartitionOffsetLag.java does not have license

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Web Link GitHub Pull Request #1545

          Activity

            People

              kabhwan Jungtaek Lim
              kabhwan Jungtaek Lim
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: