Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6617

ReplicationSourceManager should be able to track multiple WAL paths

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0, 1.3.0, 2.0.0
    • Replication
    • None
    • Reviewed
    • Hide
      ReplicationSourceManager now could track multiple wal paths. Notice that although most changes are internal and all metrics names remain the same, signature of below methods in MetricsSource are changed:

      1. refreshAgeOfLastShippedOp now requires a String parameter which indicates the wal group id of the reporter
      2. setAgeOfLastShippedOp also adds a String parameter for wal group id
      Show
      ReplicationSourceManager now could track multiple wal paths. Notice that although most changes are internal and all metrics names remain the same, signature of below methods in MetricsSource are changed: 1. refreshAgeOfLastShippedOp now requires a String parameter which indicates the wal group id of the reporter 2. setAgeOfLastShippedOp also adds a String parameter for wal group id

    Description

      Currently ReplicationSourceManager uses logRolled() to receive notification about new HLog and remembers it in latestPath.
      When region server has multiple WAL support, we need to keep track of multiple Path's in ReplicationSourceManager

      Attachments

        1. HBASE-6617.patch
          47 kB
          Yu Li
        2. HBASE-6617_v2.patch
          47 kB
          Yu Li
        3. HBASE-6617_v3.patch
          32 kB
          Yu Li
        4. HBASE-6617_v4.patch
          46 kB
          Yu Li
        5. HBASE-6617_v7.patch
          87 kB
          Yu Li
        6. HBASE-6617_v9.patch
          86 kB
          Yu Li
        7. HBASE-6617_v10.patch
          97 kB
          Yu Li
        8. HBASE-6617_v11.patch
          96 kB
          Yu Li
        9. 6617-v11.patch
          96 kB
          Ted Yu
        10. HBASE-6617_v12.patch
          96 kB
          Yu Li
        11. HBASE-6617.branch-1.patch
          96 kB
          Yu Li
        12. HBASE-6617.branch-1.v2.patch
          96 kB
          Yu Li
        13. HBASE-6617.branch-1.v2.patch
          96 kB
          Ted Yu
        14. HBASE-6617.branch-1.v2.patch
          96 kB
          Ted Yu

        Issue Links

          Is contained by

          Umbrella - An overarching type made of sub-tasks HBASE-14457 Umbrella: Improve Multiple WAL for production usage

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HBASE-14699 Replication crashes regionservers when hbase.wal.provider is set to multiwal

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              liyu Yu Li
              zhihyu@ebaysf.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: