Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11062 hbtop
  3. HBASE-19722

Meta query statistics metrics source

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Implement a meta query statistics metrics source, created whenever a regionserver starts hosting meta, removed when meta hosting moves. Provide views on top tables by request counts, top meta rowkeys by request count, top clients making requests by their hostname.

      Can be implemented as a coprocessor.

       

       

       

       

      ===============

      Release Note (WIP)

      1. Usage:

      Use this coprocessor by adding below section to hbase-site.xml

      <property>
          <name>hbase.coprocessor.region.classes</name>
          <value>org.apache.hadoop.hbase.coprocessor.MetaTableMetrics</value>
      </property>

      Attachments

        1. HBASE-19722-branch-2.1.v1.patch
          32 kB
          Sean Busbey
        2. HBASE-19722.branch-1.v002.patch
          30 kB
          Xu Cang
        3. HBASE-19722.master.016.patch
          32 kB
          Xu Cang
        4. HBASE-19722.master.015.patch
          32 kB
          Xu Cang
        5. HBASE-19722.master.014.patch
          32 kB
          Xu Cang
        6. HBASE-19722.master.013.patch
          29 kB
          Xu Cang
        7. HBASE-19722.master.012.patch
          21 kB
          Xu Cang
        8. HBASE-19722.master.011.patch
          21 kB
          Xu Cang
        9. HBASE-19722.master.010.patch
          22 kB
          Xu Cang
        10. HBASE-19722.branch-1.v001.patch
          20 kB
          Xu Cang

        Issue Links

          causes

          Task - A task that needs to be done. HBASE-21606 Document use of the meta table load metrics added in HBASE-19722

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-21991 Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-21800 RegionServer aborted due to NPE from MetaTableMetrics coprocessor

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-23054 Remove synchronization block from MetaTableMetrics and fix LossyCounting algorithm

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link "Approximate Frequency Counts over Data Streams"

          Activity

            People

              xucang Xu Cang
              apurtell Andrew Kyle Purtell
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: