pingcap / ticdc

TiCDC pulls change logs out of TiDB and pushes to kinds of systems.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

TiCDC

TiCDC pulls change logs from TiDB clusters and pushes them to downstream systems, such as MySQL, TiDB, Kafka, Pulsar, and Object Storages (e.g., S3). Beginning from v8.6, we use this repository to build TiCDC instead of the old repository tiflow. The new TiCDC in this repository has undergone a complete architectural redesign while retaining the same user interface. The architectural upgrade primarily aims to address certain drawbacks of TiCDC and propel it forward.

  • Better scalability. E.g. support over 1 million tables.
  • More efficiency. Use less machine resource to support large volume.
  • Better maintainability. E.g. simpler and human readable code, clear code module, and open to extensions.
  • Cloud native architecture. We want to design a new architecture from the ground to support the cloud.

About

TiCDC pulls change logs out of TiDB and pushes to kinds of systems.


Languages

Language:Go 85.2%Language:Shell 12.3%Language:Python 1.3%Language:ReScript 0.5%Language:PLpgSQL 0.4%Language:Makefile 0.3%