Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12904

Threading issues in region_mover.rb

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.98.9
    • 1.0.0, 0.98.10, 1.1.0
    • None
    • None
    • Reviewed

    Description

      We've seen various race conditions when using region_mover with multiple threads.

      NoMethodError: undefined method `getScanner' for nil:NilClass
  isSuccessfulScan at /home/sfdc/current//bigdata-hbase/hbase/hbase/bin/region_mover.rb:138
     unloadRegions at /home/sfdc/current//bigdata-hbase/hbase/hbase/bin/region_mover.rb:360

      NoMethodError: undefined method `[]=' for nil:NilClass
       getTable at /home/sfdc/current//bigdata-hbase/hbase/hbase/bin/region_mover.rb:64
  unloadRegions at /home/sfdc/current//bigdata-hbase/hbase/hbase/bin/region_mover.rb:359

      Looking at getTable, it's not thread safe. So the multithreaded that was added is incorrect.

      Attachments

        1. HBASE-12904.patch
          4 kB
          Andrew Kyle Purtell
        2. HBASE-12904-0.98.patch
          4 kB
          Andrew Kyle Purtell

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HBASE-12875 Region mover script region_mover.rb sometimes fail with NPE

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-8803 region_mover.rb should move multiple regions at a time

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-12875 Region mover script region_mover.rb sometimes fail with NPE

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              apurtell Andrew Kyle Purtell
              larsh Lars Hofhansl
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: