Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4172

Make public FileSystem registry

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.5.0
    • sdk-go

    Description

      https://github.com/apache/beam/blob/5743a37/sdks/go/pkg/beam/io/textio/filesystem.go

      The current beam/io/textio package includes a useful FileSystem interface and corresponding RegisterFileSystem function.  The textio package uses this internally to expose a Read(beam.Scope, string) function that will work for any file path corresponding to a registered FileSystem.

      It would be extremely useful to expose the FileSystem interface outside of just the textio package and add global analogs for each of the FileSystem interface functions using the registry.  This would allow for easier implementation of other file reading sources.

      Attachments

        Issue Links

          Activity

            People

              schroederc Cody Schroeder
              schroederc Cody Schroeder
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m