mahdiqb / modern_data_platform

Sample configuration to deploy a modern data platform.

Home Page:https://towardsdatascience.com/building-an-end-to-end-open-source-modern-data-platform-c906be2f31bd

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Sample Modern Data Platform

This repository contains the different IaC scripts to deploy a sample Modern Data Platform, accompanied with a sample dbt model.

Please refer to the main article that goes through the details of the platform and the reasoning behind the component choices.

The architecutre contains the following components:

  • BigQuery
  • Airbyte
  • dbt
  • Apache Superset
  • OpenMetadata

Architecture diagram

The platform's architecture

About

Sample configuration to deploy a modern data platform.

https://towardsdatascience.com/building-an-end-to-end-open-source-modern-data-platform-c906be2f31bd


Languages

Language:Shell 53.2%Language:HCL 46.8%