Details

    • Reviewed

    Description

      While working on the parent issue, looking at a heap from a Master tha was running ~650 servers and > 300k regions, I tripped over some silly items in the heap:

      1. Balancer has a regions x server matrix which takes up 18% of the Master heap according to jxray and 40% according to eclipse. Looks like the matrix should be regions x racks which would be much smaller (Issue came in with HBASE-18164 Fast locality computation in balancer -Added new LocalityCostFunction and LocalityCandidateGenerator ..). See

      2. Duplicate Strings make up ~5% of the Master heap. Of these, ServerName seems to be the font. Interesting is report that there 54k instances of ServerName in this heap though there are only 650 Servers. See

      3. ArrayDequeue initializes its internal elements array with 16 elements. We use this in a few places. In Procedures, of which there are many in this heap, we near never make use of this array. See

      Attachments

        1. Screen Shot 2018-07-19 at 2.43.42 PM.png
          113 kB
          Michael Stack
        2. Screen Shot 2018-07-19 at 2.43.42 PM.png
          113 kB
          Michael Stack
        3. Screen Shot 2018-07-19 at 2.22.42 PM.png
          222 kB
          Michael Stack
        4. Screen Shot 2018-07-19 at 2.22.42 PM.png
          222 kB
          Michael Stack
        5. Screen Shot 2018-07-19 at 1.38.56 PM.png
          62 kB
          Michael Stack
        6. Screen Shot 2018-07-19 at 1.38.56 PM.png
          62 kB
          Michael Stack
        7. Screen Shot 2018-07-19 at 1.20.23 PM.png
          248 kB
          Michael Stack
        8. Screen Shot 2018-07-19 at 1.20.23 PM.png
          248 kB
          Michael Stack
        9. HBASE-20914.branch-2.0.001.patch
          10 kB
          Michael Stack

        Issue Links

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: