deltalake
There are 2 repositories under deltalake topic.
delta-io / kafka-delta-ingest
A highly efficient daemon for streaming data from Kafka into Delta Lake
Language:Rust 350databrickslabs / dbldatagen
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
Language:Python 301- Language:Python 293
japila-books / delta-lake-internals
The Internals of Delta Lake
- Real-time-Data-Warehouse
izhangzhihao / Real-time-Data-Warehouse
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
Language:Dockerfile 104 smart-data-lake / smart-data-lake
Smart Automation Tool for building modern Data Lakes and Data Pipelines
Language:Scala 103WeBankFinTech / Streamis
Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.
Language:Java 101- ApacheSpark
martandsingh / ApacheSpark
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
Language:Python 90 - Language:Python 72
anneglienke / 101_upsert-delta
This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of the transaction log for the table.
Language:Python 63bhavink / databricks
Databricks Platform - Architecture, Security, Automation and much more!!
Language:Jupyter Notebook 48- Language:Python 35
DataTech-Solutions / Threat-Detection-and-Visualization
Threat Detection and Visualization
Language:TSQL 33- Language:Python 33
- Language:Python 25
ognis1205 / delta-hub
A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
Language:TypeScript 21newfront / hitchhikers_guide_to_deltalake_streaming
Don't Panic. This guide will help you when it feels like the end of the world.
Language:Jupyter Notebook 19aws-samples / amazon-emr-with-delta-lake
Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR
Language:Jupyter Notebook 16buoyant-data / oxbow
Collection of AWS Lambdas for creating and managing Delta tables
Language:Rust 15ismailhammounou / db2ixf
db2ixf is a python package with a CLI that simplifies the parsing and processing of IBM Integration eXchange Format (IXF) files.
Language:Python 15- awesome-databricks
reisdebora / awesome-databricks
A curated list of awesome Databricks resources, including Spark
- Language:Python 13
- Language:Jupyter Notebook 12
goodwillpunning / nodejs-sharing-client
A Node.js connector for Delta Sharing.
Language:JavaScript 10- Language:Python 8
- Language:TSQL 7
- Language:Rust 6
- spark_benchmark
satyakommula96 / spark_benchmark
Spark Performance Benchmark suite to evaluate all TPC-DS and TPC-H query times
Language:Scala 4 yandex-cloud / yc-delta
Delta Lake для Yandex Data Processing
Language:Java 3cmackenzie1 / deltalake-examples-rs
Examples of working with the DeltaLake in Rust!
Language:Rust 2- Language:Go 2
- Language:Scala 2
easonlai / databricks_delta_table_samples
This is a code sample repository for demonstrating how to perform Databricks Delta Table operations.
Language:HTML 2LeoneGarage / StreamJoin
A framework for incremental streaming joins and incremental streaming aggregations over change data feeds from Databricks Delta
Language:Python 2ev2900 / EMR_Studio_Delta_Lake
Deltalake examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks
Language:Jupyter Notebook 1- ifood-data
himewel / ifood-data
Ifood data wrangling with Apache Airflow and Apache Spark running on Kubernetes
Language:Python 1
