Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14831 Über-jira: S3a phase IV: Hadoop 3.1 features
  3. HADOOP-15264

AWS "shaded" SDK 1.11.271 is pulling in netty 4.1.17

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 3.0.0
    • 3.1.0, 3.0.3
    • fs/s3
    • None

    Description

      The latest versions of the AWS Shaded SDK are declaring a dependency on netty 4.1.17

      [INFO] +- org.apache.hadoop:hadoop-aws:jar:3.2.0-SNAPSHOT:compile
[INFO] |  \- com.amazonaws:aws-java-sdk-bundle:jar:1.11.271:compile
[INFO] |     +- io.netty:netty-codec-http:jar:4.1.17.Final:compile
[INFO] |     +- io.netty:netty-codec:jar:4.1.17.Final:compile
[INFO] |     +- io.netty:netty-handler:jar:4.1.17.Final:compile
[INFO] |     +- io.netty:netty-buffer:jar:4.1.17.Final:compile
[INFO] |     +- io.netty:netty-common:jar:4.1.17.Final:compile
[INFO] |     +- io.netty:netty-transport:jar:4.1.17.Final:compile
[INFO] |     \- io.netty:netty-resolver:jar:4.1.17.Final:compile

      We either exclude these or roll back HADOOP-15040.

      Attachments

        1. HADOOP-15264-001.patch
          0.6 kB
          Steve Loughran

        Issue Links

          is broken by

          Sub-task - The sub-task of the issue HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE in 1.11.199 bug spams logs w/ Yarn Log Aggregation

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: