Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10549

When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.98.0, 0.94.11, 0.96.1.1
    • 0.96.2, 0.99.0, 0.94.18
    • HFile
    • None
    • Reviewed

    Description

      First,I explan my test steps.
      1.importtsv
      2.split the region
      3.delete the region info from .META.(make a hole)
      4.LoadIncrementalHFiles (this step will hung up in an infinite loop)
      I check the log,there are two issues
      1.it create _tmp folder in an infinite loop.
      hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom
      2.when slpliting the hfile,it put the first line data(1211) into two files(top and bottom)
      Input File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0
      Input File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0
      and then I check the code.
      So I think before spliting the hfile,we should check the consistency of startkey and endkey,if something wrong,we should throw the exception,and stop LoadIncrementalHFiles.

      Attachments

        1. HBASE-10549-addendum.patch
          1 kB
          rajeshbabu
        2. HBASE-10549-0.94
          6 kB
          yuanxinen
        3. HBASE-10549-trunk-2014-03-13.patch
          7 kB
          yuanxinen
        4. HBASE-10549-trunk.patch
          9 kB
          yuanxinen

        Activity

          People

            Auraro yuanxinen
            Auraro yuanxinen
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: