Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12208

NN should consider DataNode#xmitInProgress when placing new block

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.0.0-alpha4
    • None
    • block placement, erasure-coding
    • None

    Description

      As discussed in HDFS-12044, NN only considers xceiver counts on DN when placing new blocks. NN should also consider background reconstruction works, presented by xmits on DN.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-12044 Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              eddyxu Lei (Eddy) Xu
              eddyxu Lei (Eddy) Xu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: