Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17400 Optimize S3A for maximum performance in directory listings
  3. HADOOP-17335

s3a listing operation will fail in async prefetch if fs closed

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Cannot Reproduce
    • 3.4.0
    • None
    • fs/s3
    • None

    Description

      The async prefetch logic in the S3A listing code gets into trouble if the FS closed and there was an async listing in progress.

      In this situation we should think about recognising and converting into some FS-is-closed exception

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HADOOP-13811 s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HADOOP-17074 Optimise s3a Listing to be fully asynchronous.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              mukund-thakur Mukund Thakur
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: