Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20540 [umbrella] Hadoop 3 compatibility
  3. HBASE-19369

HBase Should use Builder Pattern to Create Log Files while using WAL on Erasure Coding

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 3.0.0-alpha-1, 2.2.0, 2.1.1, 2.0.2
    • None
    • None

    Description

      Right now an HBase instance using the WAL won't function properly in an Erasure Coded environment. We should change the following line to use the hdfs.DistributedFileSystem builder pattern https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/ProtobufLogWriter.java#L92

      Attachments

        1. HBASE-19369.branch-2.0.001.patch
          15 kB
          Mike Drob
        2. HBASE-19369.master.001.patch
          2 kB
          Alex Leblang
        3. HBASE-19369.master.002.patch
          7 kB
          Alex Leblang
        4. HBASE-19369.master.003.patch
          10 kB
          Alex Leblang
        5. HBASE-19369.master.004.patch
          10 kB
          Alex Leblang
        6. HBASE-19369.v10.patch
          15 kB
          Mike Drob
        7. HBASE-19369.v11.patch
          16 kB
          Mike Drob
        8. HBASE-19369.v12.patch
          16 kB
          Mike Drob
        9. HBASE-19369.v13.patch
          15 kB
          Mike Drob
        10. HBASE-19369.v5.patch
          10 kB
          Mike Drob
        11. HBASE-19369.v6.patch
          13 kB
          Mike Drob
        12. HBASE-19369.v7.patch
          13 kB
          Mike Drob
        13. HBASE-19369.v8.patch
          15 kB
          Mike Drob
        14. HBASE-19369.v9.patch
          15 kB
          Mike Drob

        Issue Links

          is related to

          Test - A new unit, integration or system test. HBASE-19289 CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              mdrob Mike Drob
              awleblang Alex Leblang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: