delta-lake
There are 7 repositories under delta-lake topic.
- Language:Java 11551
trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Language:Java 9673StarRocks / starrocks
StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. InfoWorld’s 2023 BOSSIE Award for best open source software.
Language:Java 8033delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Language:Scala 6972roapi / roapi
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
Language:Rust 3103- Language:Rust 1882
databricks / LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Language:Scala 1104apache / incubator-xtable
Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
Language:Java 701An open protocol for secure data sharing
Language:Scala 688This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.
Language:Java 383- seafowl
splitgraph / seafowl
Analytical database for data-driven Web applications 🪶
Language:Rust 366 aws-samples / amazon-sagemaker-local-mode
Amazon SageMaker Local Mode Examples
Language:Python 233adidas / lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Language:Python 188japila-books / delta-lake-internals
The Internals of Delta Lake
josephmachado / data_engineering_best_practices
Sample project to demonstrate data engineering best practices
Language:Python 140- Real-time-Data-Warehouse
izhangzhihao / Real-time-Data-Warehouse
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
Language:Dockerfile 100 delta-incubator / delta-sharing-rs
A Minimalistic Rust Implementation of Delta Sharing Server.
Language:Rust 73tikal-fuseday / delta-architecture
Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
Language:HTML 71- Language:Scala 58
neylsoncrepalde / edc-mod1-exercise-igti
Exercícios do módulo 1 - Bootcamp EDC - IGTI 2021
Language:Python 48- Language:Python 46
- modern-data-lake-storage-layers
dacort / modern-data-lake-storage-layers
Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
Language:Jupyter Notebook 44 dask-contrib / dask-deltatable
A Delta Lake reader for Dask
Language:Python 42anneglienke / 101_upsert-delta
This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of the transaction log for the table.
Language:Python 40TatevKaren / free-resources-books-papers
Books and Papers in Mathematics, Econometrics, Machine Learning, Finance etc for different levels that can be useful for Data Scientists, Developers and everyone whoo is interesting in STEM.
databrickslabs / delta-oms
DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-rc1 release.Documentation here - https://databrickslabs.github.io/delta-oms/v0.7.0-rc1/
Language:Scala 36- delta-go
csimplestring / delta-go
Native Delta Lake Implementation in Go
Language:Go 34 ysfesr / Building-Data-LakeHouse
Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
Language:Python 33xuwenyihust / DataPulse
DataPulse is a platform for developers to build, schedule and monitor data pipelines.
Language:JavaScript 29- spark-movies-etl
guidok91 / spark-movies-etl
Spark data pipeline that processes movie ratings data.
Language:Python 26 AndrewKuzmin / spark-structured-streaming-examples
Spark structured streaming examples with using of version 3.5.1
Language:Scala 25jaehyeon-kim / dbt-on-aws
dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats
Language:HCL 19vvalcristina / Workshop-Data-Lakehouse
Repositório dedicado a Workshop de Data Lakehouse com Delta Lake
Language:Jupyter Notebook 18handreassa / delta-docker
Template to spin up delta lake locally using docker
Language:Jupyter Notebook 14Stream Loader for Apache Doris
Language:Go 13tfayyaz / awesome-azure-databricks
Awesome content all about Azure Databricks
