Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-1651

Too long fetcher default retries

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.9.0, 0.10.0, 0.10.1
    • 0.11.0
    • Data Shuffle
    • None

    Description

      The fetcher is getting an intermediate file from PullServer. fetcher will retry, when fails.
      Currently, maximum timeout is task-retry(3) * fetch-retry(20) * timeout(120 sec)
      I suggest that SHUFFLE_FETCHER_READ_RETRY_MAX_NUM change to 2

      SHUFFLE_FETCHER_READ_TIMEOUT("tajo.shuffle.fetcher.read.timeout-sec", 120)
SHUFFLE_FETCHER_READ_RETRY_MAX_NUM("tajo.shuffle.fetcher.read.retry.max-num", 20)

      Attachments

        Activity

          People

            jhkim Jinho Kim
            jhkim Jinho Kim
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: