Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11644

Support for querying outputstream capabilities

    XMLWordPrintableJSON

Details

    Description

      FSDataOutputStream#hsync checks if a stream implements Syncable, and if so, calls hsync. Otherwise, it just calls flush. This is used, for instance, by YARN's FileSystemTimelineWriter.

      DFSStripedOutputStream extends DFSOutputStream, which implements Syncable. However, DFSStripedOS throws a runtime exception when the Syncable methods are called.

      We should refactor the inheritance structure so DFSStripedOS does not implement Syncable.

      Attachments

        1. HDFS-11644.01.patch
          3 kB
          Manoj Govindassamy
        2. HDFS-11644.02.patch
          17 kB
          Manoj Govindassamy
        3. HDFS-11644.03.patch
          14 kB
          Manoj Govindassamy
        4. HDFS-11644-branch-2.01.patch
          10 kB
          Manoj Govindassamy
        5. HADOOP-16109-branch-3.1-003.patch
          15 kB
          Steve Loughran

        Issue Links

          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11718 DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-14402 roll out StreamCapabilities across output streams of all filesystems

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-12251 Add document for StreamCapabilities

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-12260 StreamCapabilities.StreamCapability should be public.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9565 Add a Blobstore interface to add to blobstore FileSystems

          • Major - Major loss of function.
          • Patch Available

          Task - A task that needs to be done. HADOOP-15149 CryptoOutputStream should implement StreamCapabilities

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-13327 Add OutputStream + Syncable to the Filesystem Specification

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-14365 Stabilise FileSystem builder-based create API

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-11170 Add builder-based create API to FileSystem

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              manojg Manoj Govindassamy
              andrew.wang Andrew Wang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: