noland254

Data-Engineering-track-with-Python

All Data Engineering notebooks from Datacamp course

dlt_demos

examples how to load data from different sources to weaviate

google_ads_backend

Web app that is integrated with Google Ads. This repo is the backend of the app.

DuckDB-ETL-Example

A simple ETL Job with Python and DuckDB

oaken-spirits

Liquor sales data engineering project

online_store

End to end data engineering project

Data-Engineering-Project-public

Practice

data-aware-orchestration

Data-aware orchestration with dagster, dbt, and airbyte

awesome-dbt

A curated list of awesome dbt resources

Django-CRM

Open Source CRM based on Django

dbt-dimensional-modelling

Step-by-step tutorial on building a Kimball dimensional model with dbt

danish-democracy-data

dagster_dbt_metabase_simple_solution

A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Dagster is the data orchestration, while DBT is for data transformation. The BI tool is Metabase.

pythondataanalysis

Python data repo, jupyter notebook, python scripts and data.

dagster-tutorial

dagster-project-example

An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has examples of unit-tests and docker deployment with a Postgresql database.

sfguide-data-engineering-with-snowpark-python

hl7r

An HL7 Parser for R

Parsing-FHIR-Files

data_engineering_best_practices

Sample project to demonstrate data engineering best practices

config

config package for R

dagster

An orchestration platform for the development, production, and observation of data assets.

sparklyr

R interface for Apache Spark

dozer-samples

Sample applications using Dozer

sparkr-tutorials

Code snippets and tutorials for working with SparkR.

python-cheatsheet

Comprehensive Python Cheatsheet

data-engineering-zoomcamp

Free Data Engineering course!