Dirk Steynberg's repositories
apache-airflow-dev-server
A Dockerised Apache Airflow Webserver
apache-airflow-data-engineer
Apache Airflow For Data Engineers Tutorial
apache-pyspark-dev-server
A Dockerised Apache service for local testing and development
ByteMeDirk
My Bio and more about what I do!
dbt-airflow-etl-project
A showcase using DBT core with Airflow in a local container
image_compressor
A PyQt5 widget that allows the user to select an image, compress it and save it to a file.
jupter-lab-dev-server
A developers environment using Jupyter Labs
metabase-aws-server
Traditional Metabase server on AWS using Terraform.
metabase-dev-server
A Dockerized Metabase Server for development.
pyspark3-docker
PySpark3 Docker container for testing & development. With OpenJDK, Spark 3.1.2, and Hadoop 2.7.
turbo-stream
A module for easily down-streaming data from a selection of vendors.
apollo_script_master
ApolloScriptMaster is an ORM solution designed for seamless management of SQL scripts within a CiCd deployment strategy.
boto3
AWS SDK for Python
cfn-python-lint
CloudFormation Linter
CollaboRate
A Federated Knowledge Sharing Platform
examples
THIS REPOSITORY IS NOT UP TO DATE. Different docker-based examples for ORY's services (Hydra, Keto, Oathkeeper).
gan-2024
A simple set of GANs
github.py
An asynchronous Python wrapper for the GitHub API, v4.
hadoop-docker
Developer Hadoop Environment with Docker
pandas
Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
RandDContainerStack
A collection of Dockerised environments ideal for research and development projects.
UnifiedDataOrchestration_DataHarmonix
Unlocking Data Harmony with Unified Data Orchestration - DataHarmonix Architecture Data Platform Architecture
WorkITApp
WorkIt is a simple ticketing and workflow analysis system.