Details
-
Task
-
Status: Closed
-
Trivial
-
Resolution: Fixed
-
0.9.0
Description
Mirroring RDBMS to HUDI is one of the most basic use cases of HUDI. Hence, for such use cases, DeltaStreamer should provide inbuilt support.
DeltaSteamer should accept something like jdbc-source.properties where users can define the RDBMS connection properties along with a timestamp column and an interval which allows users to express how frequently HUDI should check with RDBMS data source for new inserts or updates.
Details are documented in RFC-14
https://cwiki.apache.org/confluence/display/HUDI/RFC+-+14+%3A+JDBC+incremental+puller