Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11165

Scaling so cluster can host 1M regions and beyond (50M regions?)

    XMLWordPrintableJSON

Details

    • Brainstorming
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      This discussion issue comes out of "Co-locate Meta And Master HBASE-10569" and comments on the doc posted there.

      A user – our Francis Liu – needs to be able to scale a cluster to do 1M regions maybe even 50M later. This issue is about discussing how we will do that (or if not 50M on a cluster, how otherwise we can attain same end).

      More detail to follow.

      Attachments

        1. HBASE-11165.zip
          29 kB
          Andrew Kyle Purtell
        2. Region Scalability test.pdf
          124 kB
          Francis Christopher Liu
        3. zk_less_assignment_comparison_2.pdf
          45 kB
          Virag Kothari
        4. ScalableMeta.pdf
          214 kB
          Michael Stack

        Issue Links

          is a parent of

          Umbrella - An overarching type made of sub-tasks HBASE-11288 Splittable Meta

          • Major - Major loss of function.
          • Reopened
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-11267 Dynamic metrics2 metrics may consume large amount of heap memory

          • Major - Major loss of function.
          • Closed
          links to

          Web Link Scalable Meta Notes

          Activity

            People

              Unassigned Unassigned
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              58 Start watching this issue

              Dates

                Created:
                Updated: