There are 5 repositories under data-infrastructure topic.
Postgres operator creates and manages PostgreSQL clusters running in Kubernetes
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
TensorBase is a new big data warehousing with modern efforts.
A battle-tested, flexible & comprehensive monitoring solution for your PostgreSQL databases
Python function to stream unzip all the files in a ZIP archive on the fly
Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
Python function to construct a ZIP archive on the fly
Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.
Spawns JupyterHub single user servers in Docker containers running in AWS Fargate
An open source data analysis platform with features for users with a range of technical skills
Python utility function to ingest data into a SQLAlchemy-defined PostgreSQL table
A DNS proxy server that conditionally rewrites and filters A record requests
Kanadi is a Nakadi client for Scala
Python function to extract rows from a SQLite file while iterating over its bytes
Python package to parse Companies House accounts data in a streaming way
A generic data pipeline which will map Elasticsearch documents to Bigquery table rows
Information relating to topics on Data Engineering, Data Infrastructure, Data Storing, Data Warehouses and Business Analysis. For those interested in both conceptual theory and use case examples for database design and development.
Python utility function to convert an iterable of bytes or str to a readable file-like object
Service for sharing user consent to cookies across multiple domains
Python context manager to communicate with a subprocess using iterables: for when data is too big to fit in memory and has to be streamed
Stateless JWT authentication in front of PostgreSQL
Collections of POC/dev data infrastructure. | #SE
Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform
The source for the Department for International Trade's Public Data API
A collection of Streamlit components that use or are inspired by the GOV.UK Design System