Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1645

A few issues found by BEAM stress test

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.14.1
    • None
    • None

    Description

      1. Setting high priority on intermediate streams caused starvation on certain tasks. Due to the intermediate message kept coming, the input streams are not consumed and watermark messages are not generated, which makes downstream accumulates large state and makes processing slower thus make starvation worse.
      2. Watermark broadcast needs to check whether the watermark is advanced.

      Attachments

        Issue Links

          Activity

            People

              xinyu Xinyu Liu
              xinyu Xinyu Liu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: