Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6730

Enable configuration of Java transforms (specifically IO) through other SDKs

Details

    Description

      Since https://github.com/apache/beam/pull/7316 we can reference external transforms which are transforms only available in a "foreign" SDKs. This allows us to fill the gap in terms of missing transforms in the Python and Go SDK, specifically IO transforms.

      We can start collecting/exposing transforms that Beam users need. The following transforms could be interesting:

      • KafkaIO / KinesisIO
      • CassandraIO / ElasticserchIO / Hbase / Redis
      • JDBC
      • S3 file system
      • GenerateSequence

      See also https://s.apache.org/beam-cross-language-io and BEAM-6485.

      CC robertwb chamikara thw

      Attachments

        Activity

          People

            mxm Maximilian Michels
            mxm Maximilian Michels
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 12h
                12h