Kafka Connect is a framework to stream data into and out of Kafka. For more information see the documentation.
This charm sets up a Kafka connect cluster in Kubernetes and configures it to send Kafka topic data (source) to Mongodb collections (sink). The connector used can be found here
juju deploy kafka-connect-mongodb connect
juju add-relation connect kafka
juju add-relation connect mongodb
juju add-relation connect kubernetes-deployer
juju config connect "topics=topic1 topic2"
juju config connect "db-name=testdb"
juju config connect "db-collections=topic1Collection topic2Collection"
Data from topic1
will be sent to topic1Collection
and topic2
to topic2Collection
.
This software was created in the IBCN research group of Ghent University in Belgium. This software is used in Tengu, a project that aims to make experimenting with data frameworks and tools as easy as possible.
- Sander Borny sander.borny@ugent.be