Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18067 Über-jira: S3A Hadoop 3.3.5 features
  3. HADOOP-14661

S3A to support Requester Pays Buckets

    XMLWordPrintableJSON

Details

    • aws,s3,requester pays

    Description

      Amazon S3 has the ability to charge the requester for the cost of accessing S3. This is called Requester Pays Buckets.

      In order to access these buckets, each request needs to be signed with a specific header.
      http://docs.aws.amazon.com/AmazonS3/latest/dev/RequesterPaysBuckets.html

      Attachments

        1. HADOOP-14661.patch
          5 kB
          Mandus Momberg

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-18201 Remove base and bucket overrides for endpoint in ITestS3ARequesterPays.java

          • Major - Major loss of function.
          • Resolved
          depends upon

          Sub-task - The sub-task of the issue HADOOP-17511 Add an Audit plugin point for S3A auditing/context

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HADOOP-19057 S3 public test bucket landsat-pds unreadable -needs replacement

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link AWS SDK: Not all s3 requests in sdk provide option for setting Requester pays

          Web Link GitHub Pull Request #250

          Web Link GitHub Pull Request #3962

          Activity

            People

              dannycjones Daniel Carl Jones
              mandusm Mandus Momberg
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 2h Original Estimate - 2h
                  2h
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 6h 50m
                  6h 50m