Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-1752

when a regionserver shuts down writes in progress are no retried by the client

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • 0.20.0
    • None
    • None

    Description

      When a regionserver aborts, there is a window where clients are continuing to try to write to it, but the writes are failing:

      Aug 4, 2009 6:47:25 AM net.iridiant.heritrix.writer.HBaseWriterProcessor innerProcessResult
      SEVERE: Failed write of Record: http://www.rdc.udel.edu/reports/development/profdev.pdf (in thread 'ToeThread #3: http://www.rdc.udel.edu/reports/development/profdev.pdf'; in processor 'Archiver')
      java.io.IOException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact region server 172.20.3.229:60020 for region content,23d6b92bc7eb100fc1294e6b124b7e75,1249198098627, row '23d6b92bc7eb100fc1294e6b124b7e75', but failed after 10 attempts.
      Exceptions:
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      java.net.ConnectException: Call to /172.20.3.229:60020 failed on connection exception: java.net.ConnectException: Connection refused
      	at net.iridiant.heritrix.writer.HBaseWriter.write(Unknown Source)
      	at net.iridiant.heritrix.writer.HBaseWriterProcessor.write(Unknown Source)
      	at net.iridiant.heritrix.writer.HBaseWriterProcessor.innerProcessResult(Unknown Source)
      	at org.archive.modules.Processor.process(Unknown Source)
      	at org.archive.crawler.framework.ToeThread.processCrawlUri(Unknown Source)
      	at org.archive.crawler.framework.ToeThread.run(Unknown Source)
      

      The client does not retry, so the data is lost. Maybe we can get this in for RC2?

      Attachments

        Activity

          People

            Unassigned Unassigned
            apurtell Andrew Kyle Purtell
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: