swiftdiaries / fluvio-connectors

The go to place for official fluvio connectors

Fluvio - Connectors

The programmable data streaming platform - Connectors

Source Connectors

Connector	Release	Type	Protocols/Description
sources/http	0.4.2	Rust	HTTP Polling 1.0, 1.1, 2.0
sources/mqtt	0.5.2	Rust	MQTT V4, V5
sources/postgres	0.3.0	Rust	Postgres CDC
sources/syslog	0.2.0	Rust	Syslog

Sink Connectors

Connector	Release	Type	Protocols/Description
sinks/postgres	0.3.0	Rust	Postgres CDC
sinks/slack	0.3.0	Rust	Sends messages to slack
sinks/dynamodb	0.3.0	Rust	Sends messages to dynamodb
sinks/kafka	0.3.2	Rust	Sends messages to dynamodb
sinks/sql	0.1.1	Rust	Postgres/SQLite

Libs (rust-connectors/)

Lib	path	Type	Description
fluvio-connectors-common	common	Rust	Common Metadata opts

Models (rust-connectors/models)

Model	Language(s)	Description
fluvio-model-postgres	Rust	Postgres Data Model
fluvio-model-sql	Rust	Common SQL Model

SmartModules (smartmodules/)

Model	Language(s)	Description
smartmodules/json-sql	Rust	Map JSON values to SQL inserts
smartmodules/jolt	Rust	JSON to JSON transformation

Examples (examples/)

Example	Language(s)	Types	Protocols/Description	Status
python-client-connector	Python	Source	Source random cat facts	Alpha
github-stars	Rust	Source and Sink	Uses the http-source connector to fetch github stars from the github API with an aggregate smartmodule. The slack-sink connector consumes the same fluvio topic sends changes to a slack channel via a filter_map smartmodule.	Beta

Mocks (rust-connectors/utils/mocks)

Mock	Type	Description
http-json-mock	Mock	Mock used by HTTP Bats

Smart Stream (rust-connectors/utils)

Smart Stream	Description
fluvio-smartstream-map	Map

Other Helpers (rust-connectors/utils)

Helper	Type	Description
bats-helpers	Test	Bats Helpers
test-connector	Test	Test Connector

Contributing

See CONTRIBUTING.md