Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13493

Reduce the HttpServer2 thread count on DataNodes

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0, 3.2.0, 3.0.3
    • datanode
    • None
    • Reviewed

    Description

      Given that HFTP was removed in Hadoop 3 and WebHDFS is handled via Netty, the HttpServer2 instance within the DataNode is only used for very basic tasks such as the web UI. Thus we can safely reduce the thread count used here.

      Attachments

        1. HDFS-13272.000.patch
          2 kB
          Erik Krogen

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13265 MiniDFSCluster should set reasonable defaults to reduce resource consumption

          • Major - Major loss of function.
          • Patch Available
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13272 DataNodeHttpServer to have configurable HttpServer2 threads

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xkrogen Erik Krogen
              xkrogen Erik Krogen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: