artie-labs / transfer

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

Home Page:https://artie.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Kafka Topics autodiscovery

Tang8330 opened this issue · comments

So users can set it and forget it.

The fully qualified name for a table within a DB looks like this: schema.table.

Allow 2 following options to be added:

  1. RegEx (schema.*)
  2. Explicit "ignore" of tables.

AD will work if the table is found in (1) and not in (2). This is to maintain parity with Debezium. Artie and Debezium will only allow this search for non-system tables.

Hey you are doing great work want to contribute please assign to me