boxin-wbx / canal

阿里巴巴mysql数据库binlog的增量订阅&消费组件 。阿里云DRDS( https://www.aliyun.com/product/drds )、阿里巴巴TDDL 二级索引、小表复制powerd by canal.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Canal

English | 简体中文🇨🇳

Canal is a high performance data synchronization system based on MySQL binary log. Canal is widely used in Alibaba group (including https://www.taobao.com) to provide reliable low latency incremental data pipeline.

Canal Server is capable of parsing MySQL binlog and subscribe to the data change, while Canal Client can be implemented to broadcast the change to anywhere, e.g. database and Apache Kafka.

✨Features

  1. Support all platforms.
  2. Support fine-grained system monitoring, powered by Prometheus.
  3. Support parsing and subscription to MySQL binlog by different ways, e.g. by GTID.
  4. Support high performance, real-time data synchronization. (See more at Performance)
  5. Both Canal Server and Canal Client support HA/Scalability, powered by Apache ZooKeeper

Usage

🐳Docker

Canal Server Docker QuickStart

Install from source code

Canal Server QuickStart

Canal Client QuickStart

Deployment

Documentation

Contributing PRs Welcome

We strongly hope more and more people can enjoy Canal and make it better. We welcome all contributions.

About

阿里巴巴mysql数据库binlog的增量订阅&消费组件 。阿里云DRDS( https://www.aliyun.com/product/drds )、阿里巴巴TDDL 二级索引、小表复制powerd by canal.

License:Apache License 2.0


Languages

Language:Java 98.4%Language:Shell 1.2%Language:Batchfile 0.2%Language:Dockerfile 0.1%Language:Python 0.1%