Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2375

Create common SchemaProvider and RecordPayloads for spark, flink etc.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • None
    • 1.1.0
    • kafka-connect, writer-core
    • None

    Description

      Create common SchemaProvider and RecordPayloads for spark, flink etc.

      • Currently the class org.apache.hudi.utilities.schema.SchemaProvider takes in input JavaSparkContext, and is specific to Spark Engine. So we have created a separate SchemaProvider for flink. Now for Kafka connect, we can use neither, since its neither spark nor flink. Implement a common class that uses HoodieEngineContext ..

      Attachments

        Activity

          People

            Unassigned Unassigned
            rmahindra Rajesh Mahindra
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: