danjrichards / confluent-hub-data

Script to scrape the Confluent hub website to collate details of all available Connectors

Confluent Hub Data Extractor

Confluent Hub provides a searchable interface for all Kafka Connectors. This script extracts the download URLs for each by parsing the JSON used to populate the home page: https://www.confluent.io/hub/

Set up

python3 -m venv ./venv
source ./venv/bin/activate
python3 -m pip install -r requirements.txt

run the code

python3 hub-data.py