Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18886 S3A: AWS SDK V2 Migration: stabilization and S3Express
  3. HADOOP-19083

provide hadoop binary tarball without aws v2 sdk

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.4.0
    • None
    • build, fs/s3

    Description

      Have the default hadoop binary .tar.gz exclude the aws v2 sdk by default.

      This SDK brings the total size of the distribution to about 1 GB.

      Proposed

      • add a profile to include the aws sdk in the dist module
      • document it for local building
      • for release builds, we modify our release ant builds to generate modified x86 and arm64 releases without the file.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-19087 Release Hadoop 3.4.1

          • Major - Major loss of function.
          • Open
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-19206 Hadoop release contains a 530MB bundle-2.23.19.jar

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6570

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: