Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-18152 [AMv2] Corrupt Procedure WAL file; procedure data stored out of order
  3. HBASE-20745

Log when master proc wal rolls

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.2
    • Operability
    • None
    • Hide
      Log Master WAL Proc at INFO level so can tell where we transition; will help debugging/figuring accounting. Also change DEFAULT_RIT_CHORE_INTERVAL_MSEC from 5 to 60 seconds; makes it so we emit STUCK RIT notice once a minute only rather than 12 times a minute (latter was causing us to quickly roll-away the logging around problem 'events').
      Show
      Log Master WAL Proc at INFO level so can tell where we transition; will help debugging/figuring accounting. Also change DEFAULT_RIT_CHORE_INTERVAL_MSEC from 5 to 60 seconds; makes it so we emit STUCK RIT notice once a minute only rather than 12 times a minute (latter was causing us to quickly roll-away the logging around problem 'events').

    Description

      Emit when we roll master proc WAL so can see when they happen. Want to correlate instances of corruption w/ events on Master. Currently hard to do on a server where log-level is INFO (default for many deploys).

      Also, we log STUCK regions every 5 seconds. If a bundle of regions get stuck, we can log so frequently, we roll away where the problem happened so lose the chance to debug. Let me fix that too....

      Need both debugging instances of parent issue.

      Attachments

        1. HBASE-20745.master.001.patch
          3 kB
          Michael Stack

        Issue Links

          links to

          Web Link Review Board (master)

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: