Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-17587

"StorageTypeStats" Metric should not include decommissioned/in-maintenance nodes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • namenode
    • None

    Description

      When DNs are marked for Decommission or Maintenance, we are reducing the capacity used, capacity non-dfs used, capacity remaining, and total capacity in FSNamesystem metrics bean.

      But the same is not handled properly StorageTypeStats metric.

      Steps:

      1. Observe FSNamesystem bean, and BlockManager bean in a healthy cluster.
      2. Decommission/Mark for maintenance one of the DNs in the cluster.
      3. Observe the same beans, and compare with the ones taken before. (Attached screenshots for ref.)

      Attachments

        1. Before decommissioning.png
          678 kB
          Mohamed Aashif
        2. After decommissioning.png
          678 kB
          Mohamed Aashif

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-7390 Provide JMX metrics per storage type

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7483 Display information per tier on the Namenode UI

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-9034 "StorageTypeStats" Metric should not count failed storage.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              maj_aashif Mohamed Aashif
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: