KoiDev13 / gcp-koi-data-stream

Data streaming on GCP

Table of contents

Enviroment setup

Install gcloud CLI
Install Terraform

Pipeline Architecture

To do steps

Set-up Cloud Enviroment

Build Cloud Run Containers

Pub/Sub proxy server container

Data Processing service container

Dataflow Template container

Deploy using Trigger Terraform

Preferences

Big thanks to @Nucleus Engineering hack-your-pipie/01_ingest_and_transform