Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-917

Write pipeline heartbeat interval should be determined by client timeout, not DN

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.22.0
    • None
    • hdfs-client
    • None
    • Incompatible change

    Description

      For the dfs client timeouts to be more effective, they should be communicated to the DN on the start of a write, so that the DN can send heartbeats at a fast enough rate. Currently, the pipeline heartbeats are half the datanode's socket timeout, so a DFS client with a very low timeout will fail if it's not continuously writing application data.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: