Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15965

Upgrade to ADLS SDK which has major performance improvement for ingress/egress

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • fs/adl
    • None

    Description

      Upgrade ADLS SDK to version 2.3.2 which has major improvements

      1. Add special handling for 404 errors when requesting tokens from MSI
      2. Fix liststatus response parsing when filestatus object contains array in one field.
      3. Use wildfly openssl native binding with Java. This is a workaround to https://bugs.openjdk.java.net/browse/JDK-8046943issue. 2X performance boost over HTTPS. Similar to HADOOP-15669

      Attachments

        1. HADOOP-15965-002.patch
          0.6 kB
          Vishwajeet Dusane
        2. HADOOP-15965-001.patch
          0.6 kB
          Vishwajeet Dusane

        Issue Links

          causes

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-16039 backport HADOOP-15965, "Upgrade ADLS SDK to 2.3.3" to branch-2

          • Major - Major loss of function.
          • Patch Available
          is related to

          Sub-task - The sub-task of the issue HADOOP-16050 S3A SSL connections should use OpenSSL

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vishwajeet.dusane Vishwajeet Dusane
              vishwajeet.dusane Vishwajeet Dusane
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: