Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-951

Improve event loop timing metrics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.10.1
    • 0.10.1
    • metrics
    • None

    Description

      SAMZA-401 added the event-loop-utilization metric to measure the % active time in the event loop. However, the value for the event-loop-utilization (at least since samza 10) is almost always ~= 1.0, even for over-provisioned jobs, which is not very useful.

      The way it is currently measured, the active time includes choose-ns which includes time spent in poll() waiting for new messages. This waiting should be considered idle time.

      The goals of this ticket are to:
      1. Exclude the choose time from the active time to fix the event-loop-utilization metric.
      2. Add deserialization-ns and poll-ns metrics to help users understand where the time is being spent in the chooser.

      Attachments

        1. SAMZA-951_3.patch
          11 kB
          Jake Maes
        2. SAMZA-951_2.patch
          12 kB
          Jake Maes
        3. SAMZA-951_1.patch
          10 kB
          Jake Maes

        Activity

          People

            jmakes Jake Maes
            jmakes Jake Maes
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: