Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1783

Ability for HDFS client to write replicas in parallel

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs-client

    Description

      The current implementation of HDFS pipelines the writes to the three replicas. This introduces some latency for realtime latency sensitive applications. An alternate implementation that allows the client to write all replicas in parallel gives much better response times to these applications.

      Attachments

        1. HDFS-1783-trunk.patch
          15 kB
          Lars Hofhansl
        2. HDFS-1783-trunk-v2.patch
          17 kB
          Lars Hofhansl
        3. HDFS-1783-trunk-v3.patch
          22 kB
          Lars Hofhansl
        4. HDFS-1783-trunk-v4.patch
          27 kB
          Lars Hofhansl
        5. HDFS-1783-trunk-v5.patch
          35 kB
          Lars Hofhansl

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-744 Support hsync in HDFS

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1599 Umbrella Jira for Improving HBASE support in HDFS

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-6116 Allow parallel HDFS writes for HLogs.

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HBASE-4608 HLog Compression

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Rosa Rosa Ali
              dhruba Dhruba Borthakur
              Votes:
              4 Vote for this issue
              Watchers:
              48 Start watching this issue

              Dates

                Created:
                Updated: