Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10591

Sanity check table configuration in createTable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.99.0, hbase-10070
    • None
    • None
    • Reviewed
    • Hide
      Introduces sanity checks for table configuration in create and modify table against some default values. Especially we enforce region split size >= 2MB, memstore flush size >= 1MB, and 1024 <= block size <= 16MB. If you want to bypass the sanity checks, you can set "hbase.table.sanity.checks" to false, at global configuration, or at table descriptors configuration.
      Show
      Introduces sanity checks for table configuration in create and modify table against some default values. Especially we enforce region split size >= 2MB, memstore flush size >= 1MB, and 1024 <= block size <= 16MB. If you want to bypass the sanity checks, you can set "hbase.table.sanity.checks" to false, at global configuration, or at table descriptors configuration.

    Description

      We had a cluster completely become unoperational, because a couple of table was erroneously created with MAX_FILESIZE set to 4K, which resulted in 180K regions in a short interval, and bringing the master down due to HBASE-4246.

      We can do some sanity checking in master.createTable() and reject the requests. We already check the compression there, so it seems a good place. Alter table should also check for this as well.

      Attachments

        1. hbase-10591_v5.patch
          22 kB
          Enis Soztutar
        2. hbase-10591_v4.patch
          20 kB
          Enis Soztutar
        3. hbase-10591_v3.patch
          20 kB
          Enis Soztutar
        4. hbase-10591_v2.patch
          14 kB
          Enis Soztutar
        5. hbase-10591_v1.patch
          10 kB
          Enis Soztutar

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue HBASE-10791 Add integration test to demonstrate performance improvement

          • Major - Major loss of function.
          • Closed
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. HBASE-10571 TTL of zero should be rejected

          • Major - Major loss of function.
          • Closed

          Activity

            People

              enis Enis Soztutar
              enis Enis Soztutar
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: