Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20898 Improve support for HDFS at-rest encryption
  3. HBASE-20686

Asyncfs should retry upon RetryStartFileException

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • asyncclient
    • None

    • HBase 2.0, Hadoop 3 with at-rest encryption

    Description

      In Hadoop-2.6 and above, HDFS client retries on RetryStartFileException when NameNode experience encryption zone related issue. The code exists in DFSOutputStream#newStreamForCreate(). (HDFS-6970)

      In HBase-2's asyncfs implementation, FanOutOneBlockAsyncDFSOutputHelper#createOutput() is somewhat an imitation of HDFS's DFSOutputStream#newStreamForCreate(). However it does not retry upon RetryStartFileException. So it is less resilient to such issues.

      Also, DFSOutputStream#newStreamForCreate() upwraps RemoteExceptions, but asyncfs does not. Therefore, hbase gets different exceptions than before.

      File this jira to get this corrected.

      Attachments

        1. HBASE-20686.master.002.patch
          8 kB
          Wei-Chiu Chuang
        2. HBASE-20686.master.001.patch
          5 kB
          Wei-Chiu Chuang

        Activity

          People

            Unassigned Unassigned
            weichiu Wei-Chiu Chuang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: