Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2832 Enable support for heterogeneous storages in HDFS - DN as a collection of storages
  3. HDFS-5390

Send one incremental block report per storage directory

    XMLWordPrintableJSON

Details

    Description

      Incremental block reports should be sent per storage directory since the NameNode now expects all block reports to be sent per storage. Currently the Datanode tracks pending incremental block reports for all storages in a single queue.

      This is a continuation of the work started by HDFS-5134 and HDFS-4988 to split block processing per storage directory.

      Attachments

        1. h5390.03.patch
          32 kB
          Arpit Agarwal
        2. h5390.04.patch
          30 kB
          Arpit Agarwal

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-4988 Datanode must support all the volumes as individual storages

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-5134 NameNode improvements to per-storage block processing

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDFS-5406 Send incremental block reports for all storages in a single call

          • Major - Major loss of function.
          • Closed
          requires

          Sub-task - The sub-task of the issue HDFS-5377 Heartbeats from Datandode should include one storage report per storage directory

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-5398 NameNode changes to process storage reports per storage directory

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              arp Arpit Agarwal
              arp Arpit Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: