Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6284

Introduce HRegion#doMiniBatchMutation()

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      From Anoop under thread 'Can there be a doMiniBatchDelete in HRegion':

      The HTable#delete(List<Delete>) groups the Deletes for the same RS and make one n/w call only. But within the RS, there will be N number of delete calls on the region one by one. This will include N number of HLog write and sync. If this also can be grouped can we get better performance for the multi row delete.

      I have made the new miniBatchDelete () and made the HTable#delete(List<Delete>) to call this new batch delete.
      Just tested initially with the one node cluster. In that itself I am getting a performance boost which is very much promising.
      Only one CF and qualifier.
      10K total rows delete with a batch of 100 deletes. Only deletes happening on the table from one thread.
      With the new way the net time taken is reduced by more than 1/10
      Will test in a 4 node cluster also. I think it will worth doing this change.

      Attachments

        1. 6284_Trunk-Addendum.patch
          0.8 kB
          Anoop Sam John
        2. 6284_Trunk-V3.patch
          25 kB
          Ted Yu
        3. HBASE-6284_94.patch
          23 kB
          Anoop Sam John
        4. HBASE-6284_Trunk.patch
          24 kB
          Anoop Sam John
        5. HBASE-6284_Trunk-V2.patch
          24 kB
          Anoop Sam John
        6. HBASE-6284_Trunk-V3.patch
          25 kB
          Anoop Sam John

        Activity

          People

            anoopsamjohn Anoop Sam John
            zhihyu@ebaysf.com Ted Yu
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: