This repository allows you to configure and provision a cloud-based workshop using your preferred cloud provider GCP, AWS or Azure. Each workshop participant connects to their own virtual machine and is intended to act as a psuedo on-premise datacenter. A single Confluent Cloud cluster is shared by all workshop participants.
For a single workshop participant, the logical architecture looks like this.
From a physical architecture point of view, each component, except for Confluent Cloud, is hosted on the participant's virtual machine.
Each workshop participant will work through a series of Labs to create the following ksqlDB Supply & Demand Application.
- macOS or Linux
- Terraform 0.12.20 or later
- Python + Yaml
- A GCP/AWS/Azure account with the appropriate privileges
- A Confluent Cloud Account
- MongoDB Realm CLI (required if you use the MongoDB Atlas extension)
Create an empty directory somewhere that will contain your workshop configuration file.
mkdir ~/myworkshop
Copy workshop-example-<cloud provider>.yaml to workshop.yaml in the directory you just created.
cp workshop-<cloud provider>-example.yaml ~/myworkshop/workshop.yaml
Edit ~/myworkshop/workshop.yaml and make the required changes.
Change your current directory to the root of the repository
cd ~/confluent-hybrid-cloud-workshop
To start provisioning the workshop, run workshop-create.py and pass in your workshop directory
python workshop-create.py --dir ~/myworkshop
When you are finished with the workshop you can destroy it using workshop-destroy.py
python workshop-destroy.py --dir ~/myworkshop
If you ever need root access on the docker containers use:
docker exec --interactive --tty --user root --workdir / kafka-connect-ccloud bash
See this blog post for more info
This project is licensed under the Apache 2.0 - see the LICENSE.md file for details