Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25793

Fix high throughput rate of AsyncSinkWriter for throttled destination

    XMLWordPrintableJSON

Details

    Description

      Bug:

      The Async Sink Base sink is not limiting throughput to the destination and therefore exceeding rate limits

      Cause:

      We are not throttling our requests downstream at all.

      We should monitor for requests that have failed with ThroughputExceeded exceptions and reduce the throughput accordingly.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-25792 Async Sink Base is too being flushed too frequently resulting in backpressure even when buffer is near empty

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #18880

          Web Link GitHub Pull Request #18902

          Activity

            People

              chalixar Ahmed Hamdy
              CrynetLogistics Zichen Liu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: