Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-8342

Add Automatic Retry for Rate Limited APIs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.20.2
    • 1.21.0
    • Storage - HTTP
    • None

    Description

      Many APIs have a burst limit for number of requests.  This PR adds a retry capability to the HTTP Storage Plugin, whereby if a 429 response code is received, Drill will wait a configurable amount of time, and retry the request once. 

      To prevent runaway pagination, this retry will only happen once per request. 

      This PR adds a new configuration option called retryDelay which is the number of milliseconds that Drill should wait between retrys.

      Attachments

        Activity

          People

            cgivre Charles Givre
            cgivre Charles Givre
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: