Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12424

Finer grained logging and metrics for split transactions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.98.8, 0.99.2
    • None
    • None
    • Reviewed

    Description

      A split transaction is a complex orchestration of activity between the RegionServer, Master, ZooKeeper, and HDFS NameNode. We have some visibility into the time taken by various phases of the split transaction in the logs. We will see "Starting split of region $PARENT" before the transaction begins, before the parent is offlined. Later we will see "Opening $DAUGHTER" as one of the last steps in the transaction, this is after the parent has been flushed, offlined, and closed. Finally ""Region split, hbase:meta updated, and report to master ... Split took $TIME" after all steps are complete and including the total running time of the transaction.

      For debugging the cause(s) of long running split transactions it would be useful to know the distribution of time spent in all of the phases of the split transaction.

      Attachments

        1. HowHBaseRegionSplitsareImplemented.pdf
          329 kB
          Andrew Kyle Purtell
        2. 0001-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch
          7 kB
          Andrew Kyle Purtell
        3. 0002-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch
          10 kB
          Andrew Kyle Purtell
        4. 0003-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch
          7 kB
          Andrew Kyle Purtell
        5. HBASE-12424.patch
          20 kB
          Andrew Kyle Purtell
        6. HBASE-12424.patch
          20 kB
          Andrew Kyle Purtell
        7. HBASE-12424-0.98.patch
          22 kB
          Andrew Kyle Purtell
        8. HBASE-12424.patch
          22 kB
          Andrew Kyle Purtell
        9. HBASE-12424-addendum.patch
          5 kB
          Andrew Kyle Purtell

        Issue Links

          Activity

            People

              apurtell Andrew Kyle Purtell
              apurtell Andrew Kyle Purtell
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: