Mage

mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

mage-zoomcamp

This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main

mage-ai-terraform-templates

Terraform templates for deploying mage-ai to AWS, GCP and Azure

magic-devcontainer

A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.

docker

Dockerfile and Docker compose templates

compose-quickstart

A quickstart repo for Mage using Docker compose.

helm-charts

assets

Media assets used in repository documentation.

dbt-quickstart

datasets

Datasets to play with.

dbt-mysql

dbt-mysql contains all of the code enabling dbt to work with MySQL and MariaDB

demo_etl_pipeline

Demo pipeline for loading, transforming, and exporting restaurant data.

platform_template

Mage project platform template for using multiple projects and other non-Mage projects in 1 Mage ultra project.

sqlglot

Python SQL Parser and Transpiler

.github

delta-rs

A native Rust library for Delta Lake, with bindings into Python and Ruby.

etl-demo

Mage ELT demo for pulling data from an API, performing transformations, and writing to a local DuckDB database.

google-ads-python

Google Ads API Client Library for Python

jupyter_client

Jupyter protocol client APIs

mage-libpostal-docker

Sample Mage docker compose for building a docker image with libpostal

mage_demo_project

Demo project containing data integration pipelines and batch transformation pipelines.

singer-python

Writes the Singer format from Python

demo_project

Demo project for quick start tutorial

mage-ai-cdk

AWS Cloud Development Kit (CDK) scripts for deploying Mage to AWS

dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt-synapse

dbt adapter for Azure Synapse Dedicated SQL Pools

reaflow

🎯 React library for building workflow editors, flow charts and diagrams. Maintained by @goodcodeus.