Crawler Demo for 200LAB DevOps Course

In this course, we will set up the CI/CD and infrastructure for the crawler systems below on Kubernetes.

Overview System

Crawler System: crawler posts + redis stream + consumer

Change Data Capture System: Postgres + Kafka Connect + Elasticsearch

API Service: Rust + Postgres + Elasticsearch

Language:Go 56.3%Language:Rust 29.8%Language:Dockerfile 6.8%Language:Shell 5.1%Language:JavaScript 1.9%