Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-3583

Handle exceptions when AsyncLocalizer tries to get local resources

    XMLWordPrintableJSON

Details

    Description

      Supervisor relies on AsyncLocalizer to download blobs from blob store.
      AsyncLocalizer uses downloadService pool to process CompletableFuture objects in parallel.

      We have noticed a case that while the downloading task is waiting for a thread to execute, new assignment changes will try to release the slot by dereferences all of the related local resources.

      However, reading local resources assumes two base blob downloading task have been completed which is not always true.
       

      Attachments

        Activity

          People

            li530 Rui Li
            kishorvpatil Kishor Patil
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 4h 50m
                4h 50m