Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10822

Log DataNodes in the write pipeline

    XMLWordPrintableJSON

Details

    Description

      Trying to diagnose a slow HDFS flush, taking longer than 10 seconds, but did not know which DNs were involved in the write pipeline. Of course, I could search NN log for the list of DNs, but it might not be possible sometimes or convenient.

      Propose to add a DEBUG trace to DataStreamer#setPipeline to print the list of DNs in the pipeline.

      BTW, we do print the list of DNs during pipeline recovery.

      Attachments

        1. HDFS-10822.001.patch
          1 kB
          John Zhuge

        Activity

          People

            jzhuge John Zhuge
            jzhuge John Zhuge
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: