apache-iceberg
There are 1 repository under apache-iceberg topic.
- matano
matanolabs / matano
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
Language:Rust 1358 apache / incubator-xtable
Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
Language:Java 691- Language:JavaScript 283
- Language:Scala 57
dominikhei / Local-Data-LakeHouse
Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.
Language:Dockerfile 45- modern-data-lake-storage-layers
dacort / modern-data-lake-storage-layers
Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
Language:Jupyter Notebook 44 aws-samples / transactional-datalake-using-apache-iceberg-on-aws-glue
Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and DMS
Language:Python 19Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3
Language:Python 14tj--- / iceberg-demo
A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
Language:Java 13tlepple / data_origination_workshop
Hands-on workshop with Iceberg, Redpanda, Debezium and Kafka-Connect
Language:Shell 11Hands-on workshop with Apache Iceberg
Language:Shell 10This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
Language:Python 7gordonmurray / apache_flink_and_iceberg
Using Apache Flink to write to s3 in Apache Iceberg format
davidvanegas2 / iceberg-s3-terraform-glue
Automated setup of Apache Iceberg on Amazon S3 using Terraform and AWS Glue Data Catalog. Explore the power of a Lakehouse architecture for data management and analysis, featuring schema discovery, metadata management, and efficient querying with Amazon Athena.
Language:Python 5YeonwooSung / MLOps
Miscellaneous codes and writings for MLOps
Language:Jupyter Notebook 4Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming using Amazon MSK Serverless and MSK Connect (Debezium)
Language:Python 3- lakehouse-poc
fraibacas / lakehouse-poc
Run an open-source data LakeHouse locally using Docker Compose
Language:Python 3 joewood / react-iceberg
React Components to visualize Apache Iceberg tables
Language:TypeScript 2MOBIN-F / iceberg-spark-tpcds-benchmark
iceberg-spark-tpcds-benchmark
Language:Scala 2Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming using Amazon MSK and MSK Connect (Debezium)
Language:Python 1ev2900 / EMR_Studio_Iceberg
Apache Icebery examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks
Language:Jupyter Notebook 1Resources from an virtual tech talk / workshop - Set Up and Use Apache Iceberg Tables on Your Data Lake
Language:Jupyter Notebook 1- Language:Java 1
- Language:Java
Process DynamoDB change streams via. AWS Glue w Iceberg to keep a copy of a collection in S3 upto date
Language:Pythonjohnymontana / hands-on-havasu-geoparquet
Notebook to accompany the "Hands-On With Havasu & GeoParquet" livestream
Language:Jupyter Notebookksmin23 / aws-glue-iceberg-blog
"Apache Iceberg Connector for AWS Glue를 이용하여 데이터레이크 CRUD 하기" 포스팅 내용 실습 프로젝트
Language:PythonStream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and MSK Connect (Debezium)
Language:PythonStream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and MSK Connect (Debezium)
Language:Python
