⚡Replicate your Database to Clickhouse in real time without Debezium, Kafka, or Clickhouse Materialized Engines
APACHE-2.0 License
db2ch
is still under heavy development. We reccommend that you not try to use it for production use until development has progressed more and bugs are less likely to occur.
db2ch
is an open-source framework designed to simplify Change Data Capture (CDC) to ClickHouse without the need for complex setups like Debezium, Kafka, or ClickHouse Materialized Views. This project supports real-time data replication from PostgreSQL, MySQL, and MSSQL to ClickHouse.
db2ch
will automatically map source data types to Clickhouse data types and create tables.db2ch
also includes a capability to perform a backfil to bring across historic data.db2ch
replication allows you to control which columns you bring across.db2ch/
├── main.go
├── config/
│ ├── config.go
│ ├── config.json
├── api/
│ ├── handler.go
│ └── routes.go
├── replication/
│ ├── replication.go
│ ├── clickhouse.go
│ ├── mysql.go
│ └── mssql.go
└── go.mod
config/
- The purpose of this directory is define configuration details (connection details, data mapping, http port, etc).api/
- Contains the routes
for HTTP API endpoints and a handler for core api functionality.replication/
- The framework behind listening to data and producing data.Clone the repository:
git clone https://github.com/cqllum/db2ch.git
cd db2ch