Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2856

TestAcidGuarantee broken on trunk

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.89.20100621
    • 0.94.0
    • None
    • None

    Description

      TestAcidGuarantee has a test whereby it attempts to read a number of columns from a row, and every so often the first column of N is different, when it should be the same. This is a bug deep inside the scanner whereby the first peek() of a row is done at time T then the rest of the read is done at T+1 after a flush, thus the memstoreTS data is lost, and previously 'uncommitted' data becomes committed and flushed to disk.

      One possible solution is to introduce the memstoreTS (or similarly equivalent value) to the HFile thus allowing us to preserve read consistency past flushes. Another solution involves fixing the scanners so that peek() is not destructive (and thus might return different things at different times alas).

      Attachments

        1. acid.txt
          10 kB
          Michael Stack
        2. 2856-v9-all-inclusive.txt
          100 kB
          Amitanand Aiyer
        3. 2856-v8.txt
          40 kB
          Amitanand Aiyer
        4. 2856-v7.txt
          67 kB
          Amitanand Aiyer
        5. 2856-v6.txt
          40 kB
          Amitanand Aiyer
        6. 2856-v5.txt
          111 kB
          Michael Stack
        7. 2856-v4.txt
          90 kB
          Michael Stack
        8. 2856-v3.txt
          77 kB
          Michael Stack
        9. 2856-v2.txt
          41 kB
          Michael Stack
        10. 2856-0.92.txt
          92 kB
          Lars Hofhansl

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-3149 Make flush decisions per column family

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5121 MajorCompaction may affect scan's correctness

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4570 Scan ACID problem with concurrent puts.

          • Major - Major loss of function.
          • Closed
          is required by

          Sub-task - The sub-task of the issue HBASE-4838 Port 2856 (TestAcidGuarantee is failing) to 0.92

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-3404 Compaction Ordering for Bulk Import Files

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-3290 Max Compaction Size

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HBASE-3498 Memstore scanner needs new semantics, which may require new data structure

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-3543 Get rid of "delete forward"

          • Major - Major loss of function.
          • Closed

          Activity

            People

              amitanand Amitanand Aiyer
              ryanobjc ryan rawson
              Votes:
              0 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: