artie-labs / reader

Perform historical snapshots without database locks and read change data capture logs from databases. Artie Reader is compatible with Debezium and is written in Go.

Artie Reader

📚 Perform historical snapshots and read CDC streams from databases 📚

Learn more »

Artie Reader reads from databases to perform historical snapshots and also reads change data capture (CDC) logs for continuous streaming. The generated messages are Debezium capable.

Benefits

• Historical table snapshots do not require database locks, which means Artie Reader minimizes impact to database performance and avoids situations like replication slot overflow.
• Debezium compatible. The generated messages are consistent with Debezium’s message format.
• Portable and easy to operate. Shipped as a standalone binary with no external dependencies.

Architecture

Supports:

	Snapshot	Streaming
DynamoDB	✅	✅
MongoDB	✅	❌
MySQL	✅	❌
PostgreSQL	✅	❌
SQL Server	✅	❌

Running

To get started, you'll need a config.yaml file, you can see examples of this in the examples folder.

go run main.go --config config.yaml