Uploaded image for project: 'Apache Knox'
  1. Apache Knox
  2. KNOX-1221

WebHDFS read/write performance limitations

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Information Provided
    • 0.9.0, 0.10.0, 0.11.0, 0.12.0, 0.13.0, 0.14.0, 1.0.0, 1.1.0
    • 1.2.0
    • Server
    • None

    Description

      If I use direct connection to WebHDFS from one node I have speed nearly several gigabites/sec when download or upload large files. But if I use knox I have ulpload/download speed only 100mbit/sec from the same node. Found that knox limits speed for one https session. As a workaround I upload large files through knox in parallel but it is not a good way.

      Couldn't find any configuration params that can control such behaviour. Is it a code limitation?

      Attachments

        1. rtk.xml
          2 kB
          Georgy
        2. gateway-site.xml
          4 kB
          Georgy

        Issue Links

          Activity

            People

              krisden Kevin Risden
              maythes Georgy
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: