Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2316

[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.23.1, 1.0.0
    • webhdfs
    • Hide
      Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP.
      Previous hftp feature was a read-only FileSystem and does not provide "write" accesses.
      Show
      Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP. Previous hftp feature was a read-only FileSystem and does not provide "write" accesses.

    Description

      We current have hftp for accessing HDFS over HTTP. However, hftp is a read-only FileSystem and does not provide "write" accesses.

      In HDFS-2284, we propose to have WebHDFS for providing a complete FileSystem implementation for accessing HDFS over HTTP. The is the umbrella JIRA for the tasks.

      Attachments

        1. test-webhdfs
          0.4 kB
          Tsz-wo Sze
        2. test-webhdfs-0.20s
          0.5 kB
          Tsz-wo Sze
        3. WebHdfsAPI20111020.pdf
          141 kB
          Tsz-wo Sze
        4. WebHdfsAPI20111103.pdf
          183 kB
          Tsz-wo Sze
        5. WebHdfsAPI20111111.pdf
          211 kB
          Tsz-wo Sze

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HDFS-843 Add HTTP POST/PUT/DELETE support for web servers in datanodes

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2645 Webhdfs & HttpFS (Hoop) should share the same codebase

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue HDFS-12512 RBF: Add WebHDFS

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-2361 hftp is broken

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-7721 dfs.web.authentication.kerberos.principal expects the full hostname and does not replace _HOST with the hostname

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-2368 defaults created for web keytab and principal, these properties should not have defaults

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-2409 _HOST in dfs.web.authentication.kerberos.principal.

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-2545 Webhdfs: Support multiple namenodes in federation

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2631 Add optional libwebhdfs support to fuse-dfs

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2656 Implement a pure c client based on webhdfs

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HDFS-2552 Add WebHdfs Forrest doc

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HDFS-2587 Add WebHDFS apt doc

          • Major - Major loss of function.
          • Closed
          There are no Sub-Tasks for this issue.

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              24 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: