GSOC : Support connect to Clickhouse in Apache RocketMQ Connect

Apache RocketMQ™ is a unified messaging engine, lightweight data processing platform,

• Apache RocketMQ

Apache RocketMQ Streams is a Lightweight Streaming Project for RocketMQ , which can be deployed separately or in cluster mode.
Various types of data input and output: source supports RocketMQ while sink supports databases and RocketMQ, etc.

• Apache RocketMQ Streams

ClickHouse® is a column-oriented database management system (DBMS) for online analytical processing of queries (OLAP). built by the creators of the fastest OLAP database on Earth

• ClickHouse

• True Column-Oriented Database Management System
• Data Compression¶
• Disk Storage of Data
• Parallel Processing on Multiple Cores
• Distributed Processing on Multiple Servers
• SQL Support
• Vector Computation Engine
• Real-time Data Updates
• Primary Index
• Secondary Indexes
• Suitable for Online Queries
• Support for Approximated Calculations
• Adaptive Join Algorithm
• Data Replication and Data Integrity Support
• Role-Based Access Control
• Features that Can Be Considered Disadvantages

The Clickhouse Sink in RocketMQ allows moving data from RocketMQ to Clickhouse. It writes data from topics in RocketMQ to tables in Clickhouse.

So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.

You should learn before applying for this topic

• Apache RocketMQ
• Clickhouse Docs
• Clickhouse on Github
• Apache RocketMQ Streams

Mentor

• tigerlee@apache.org