Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18886 S3A: AWS SDK V2 Migration: stabilization and S3Express
  3. HADOOP-19072

S3A: expand optimisations on stores with "fs.s3a.performance.flags" for mkdir

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      on an s3a store with fs.s3a.create.performance set, speed up other operations

      • mkdir to skip parent directory check: just do a HEAD to see if there's a file at the target location

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-19161 S3A: option "fs.s3a.performance.flags" to take list of performance flags

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6543

          Web Link GitHub Pull Request #6985

          Web Link GitHub Pull Request #6993

          Activity

            People

              vjasani Viraj Jasani
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: