Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9565

Add a Blobstore interface to add to blobstore FileSystems

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.6.0
    • None
    • fs, fs/s3, fs/swift
    • None

    Description

      We can make the fact that some FileSystem implementations are really blobstores, with different atomicity and consistency guarantees, by adding a Blobstore interface to add to them.

      This could also be a place to add a Copy(Path,Path) method, assuming that all blobstores implement at server-side copy operation as a substitute for rename.

      Attachments

        1. HADOOP-9565-010.patch
          46 kB
          Steve Loughran
        2. HADOOP-9565-008.patch
          66 kB
          Mingliang Liu
        3. HADOOP-9565-branch-2-007.patch
          71 kB
          Pieter Reuse
        4. HADOOP-9565-006.patch
          65 kB
          Steve Loughran
        5. HADOOP-9565-005.patch
          55 kB
          Thomas Demoor
        6. HADOOP-9565-004.patch
          51 kB
          Thomas Demoor
        7. HADOOP-9565-003.patch
          26 kB
          Steve Loughran
        8. HADOOP-9565-002.patch
          17 kB
          Steve Loughran
        9. HADOOP-9565-001.patch
          16 kB
          Steve Loughran

        Issue Links

          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-11556 SwiftNativeFileSystem rename being interrupted during "fs -put"

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9577 Actual data loss using s3n (against US Standard region)

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-11487 FileNotFound on distcp to s3n/s3a due to creation inconsistency

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11525 FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

          • Major - Major loss of function.
          • Closed
          is related to

          Sub-task - The sub-task of the issue HADOOP-11867 Add a high-performance vectored read API.

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-11704 OzoneFileSystem: A Hadoop file system implementation for Ozone

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-12046 Avoid creating "._COPYING_" temporary file when copying file to Swift file system

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-16604 Provide copy functionality for cloud native applications

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-14402 roll out StreamCapabilities across output streams of all filesystems

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11644 Support for querying outputstream capabilities

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9361 Strictly define the expected behavior of filesystem APIs and write tests to verify compliance

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11525 FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              1 Vote for this issue
              Watchers:
              52 Start watching this issue

              Dates

                Created:
                Updated: