Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10935

support snapshot policy where flush memstore can be skipped to prevent production cluster freeze

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.94.7, 0.94.18
    • 0.99.0, 0.94.21, 0.98.4
    • shell, snapshots
    • None

    Description

      We are using snapshot feature to do HBase disaster recovery. We will do snapshot in our production cluster periodically. The current flush snapshot policy require all regions of the table to coordinate to prevent write and do flush at the same time. Since we use WALPlayer to complete the data that is not in the snapshot HFile, we don't need the snapshot to do coordinated flush. The snapshot just recored all the HFile that are already there.

      I added the parameter in the HBase shell. So people can choose to use the NoFlush snapshot when they need, like below. Otherwise, the default flush snpahot support is not impacted.

      >snaphot 'TestTable', 'TestSnapshot', 'skipFlush'

      Attachments

        1. HBASE-10935-0.94-v1.patch
          13 kB
          Matteo Bertozzi
        2. HBASE-10935-0.98-v1.patch
          17 kB
          Matteo Bertozzi
        3. hbase-10935-94.patch
          12 kB
          Tianying Chang
        4. hbase-10935-trunk.patch
          13 kB
          Tianying Chang
        5. HBASE-10935-trunk-v1.patch
          16 kB
          Matteo Bertozzi
        There are no Sub-Tasks for this issue.

        Activity

          People

            tychang Tianying Chang
            tychang Tianying Chang
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: