hudi

There are 3 repositories under hudi topic.

• apache / doris

  Apache Doris is an easy-to-use, high performance and unified analytics database.

  olapdatabasehadoophivehudiicebergreal-timesqlbigquerydbtdelta-lakeeltetllakehousequery-engineredshiftsnowflakespark
  Language:Java 11337

• StarRocks / starrocks

  StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. InfoWorld’s 2023 BOSSIE Award for best open source software.

  databaseolapsqlanalyticsbig-datarealtime-databasevectorizeddistributed-databasereal-time-analyticsmppjoinstar-schemareal-time-updatesdelta-lakehudiiceberglakehousedatalakelakehouse-platformcloudnative
  Language:Java 7755

• apache / hudi

  Upserts, Deletes And Incremental Processing on Big Data.

  hudiapachehudidatalakebigdataapachesparkincremental-processingstream-processingdata-integrationapacheflink
  Language:Java 5062
• alldata

  alldatacenter / alldata

  🔥🔥 AllData大数据产品是可定义数据中台，以数据平台为底座，以数据中台为桥梁，以机器学习平台为中层框架，以大模型应用为上游产品，提供全链路数字化解决方案。全新会员商业版 X 微信群：https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo

  flinkgriffinhudiicebergkongpaimonrangertisdatartdinkystreamparkcube-studiodatasophoncloudeonartificial-intelligencebig-datachatgptdolphinschedulermlopsmlrun
  Language:Java 2300

• collabH / bigdata-growth

  大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

  flinkkafkahivemapreducesparkolapkuduhadoophbasedebeziumhdfsbigdatahudibigdatalearning
  Language:Shell 1263

• leesf / hudi-resources

  汇总Apache Hudi相关资料

  hudiapachehudiapachehudi-resourcesdatalakebigdatastream-processingincremental-processingdata-integration
  518

• fancyChuan / bigdata-hub

  数据建设与大数据技术知识体系，包含hadoop、hive、spark、flink主流框架和系列框架，数据中台、数据湖、数据治理、数仓建设、数据化转型等

  bigdatahadoopsparkflinkhivebigdata-constructionbigdata-platformhudikafkaclickhouseseatunnel
  Language:Java 257
• Real-time-Data-Warehouse

  izhangzhihao / Real-time-Data-Warehouse

  Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

  flinkdata-warehousereal-time-data-warehousedata-warehousingflink-sqldebeziumkafkaelasticsearchdelta-lakecdcchange-data-capturehudihoodieicebergsqldatalakedeltadeltalakesparkspark-sql
  Language:Dockerfile 99

• WeBankFinTech / Streamis

  Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.

  flinklinkisdataspherestudiowedataspherestreamisstreaminghudiicebergdatalakewarehousekafkadeltalake
  Language:Java 97

• leesf / hudi-demos

  汇总Apache Hudi中的一些Demo，便于快速上手Apache Hudi(Apache Hudi Demos to help beginners know about Hudi)

  apachehudihudihudidemos
  Language:Java 70

• apache / doris-website

  Apache Doris Website

  dorisanalyticsapachebig-datadata-warehousingdatabasedatalakedbmsdistributed-systemhadoophivehudiicebergmppolapssbtpchvectorized
  Language:TypeScript 64
• modern-data-lake-storage-layers

  dacort / modern-data-lake-storage-layers

  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work

  awsamazon-emrhudiicebergapache-hudiapache-icebergdelta-lake
  Language:Jupyter Notebook 43

• apache / doris-thirdparty

  Self-managed thirdparty dependencies for Apache Doris

  analyticsbig-datadata-warehousingdatabasedatalakedbmsdistributed-databasehadoophivehudiicebergmppolapreal-timesqlssbtpchvectorized
  27

• 1ambda / lakehouse

  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)

  flinkhudiicebergsparktrinodbtdockerairflowcdcdebeziumkafka
  Language:Kotlin 26

• Mrkuhuo / bigdata_learning

  大数据组件学习代码

  flinkhadoopjavapythonsparkclickhousedataxdolphinschedulerdoriselasticsearchhbasehivehudiicebergcdh5sqoop
  Language:Java 22

• jaehyeon-kim / dbt-on-aws

  dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats

  athenadbtdelta-lakeemrgluehudiicebergredshift
  Language:HCL 17

• apache / doris-streamloader

  Stream Loader for Apache Doris

  bigquerydatabasedbtdelta-lakeeltetlhadoophivehudiiceberglakehouseolapquery-enginereal-timeredshiftsnowflakesparksql
  Language:Go 11

• shangyuantech / hudi-multistream

  Consumption and writing to Hudi based on multiple topic

  hudi
  Language:Java 8

• apache / doris-sdk

  SDK for Apache Doris

  bigquerydatabasedbtdelta-lakeeltetlhadoophivehudiiceberglakehouseolapquery-enginereal-timeredshiftsnowflakesparksql
  Language:Thrift 6

• bihaiyang / datalake-example

  Data lake implementation demo, include iceberg on flink, iceberg on spark, hudi on flink, hudi on spark

  icebergdatalakehudialluxioflinksparkflinksqlsparksql
  Language:Java 6

• sanhebigdata / bigdatateam

  数据中台建设、离线数仓建设、实时数仓建设、数据湖建设、区块链技术应用。组件包括但不限于：flink/spark/hadoop/hive/kafka/doris/kudu/clickhouse

  flinkhadoophivehudikudusparkcannaldebeziumflink-cdckafkamaxwell
  6

• ev2900 / EMR_Studio_Hudi

  Apache Hudi examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks

  hudiemrelastic-map-reduceapache-hudihudi-examplesaws
  Language:Jupyter Notebook 3

• MaximeGuinard / HUD-MX

  ⌨️ A hud addon it allows to have a personalized HUD menu for Garry's mod

  gmodgmod-addongmod-loadingscreengmod-luagmod-modulegmodluagmodstorehudhuddle-landing-pagehudigmod-gamemodegmod-gamemodesgmod-modulesgmodaddon
  Language:Lua 3

• Chenzhiling / datalake-metadata-api

  this project can help you to get iceberg,delta,hudi table's metadata info by java

  delta-lakehudiicebergjavametadata-api
  Language:Java 2

• xushiyan / apachehudi-from0to1

  Companion code and examples for blog series - Apache Hudi: From Zero To One

  apachehudibig-databigdatabloghudihudi-examples
  2

• cevoaustralia / data-lake-demo

  Data lake demo using change data capture (CDC) on AWS

  awskafkakafka-connectoraws-mskaws-emraws-athenaaws-quicksightdata-lakehudidebeziumlensesaws-aurora
  Language:PLpgSQL 1

• guanlisheng / presto-event-stream

  Stream events from presto to a kafka topic

  hudikafkaprestopresto-pluginquery-historyschema
  Language:Java 1

• jasondavindev / delta-lake-dms-cdc

  Example application for DMS CDC with Delta Lake and Apache Hudi

  cdcdeltalakedmshudispark
  Language:Python 1

• lakeops / lakehouse

  湖仓一体

  datalakedatalake-etlhudiicebergdelta-lakekylo
  1

• runalddsouza / hudi-kafka

  Data ingestion using Hudi DeltaStreamer and Kafka

  hudikafkakafka-producerdocker
  Language:Python 1

• jasondavindev / spark-glue-hudi

  Docker image with Spark + Glue + Hudi

  awsdockergluehivehudispark
  Language:Dockerfile 0

• kiran94 / dca-manager

  Automated Dollar Cost Average Process

  cryptodcagluehudiinvestingkrakentrading
  Language:Go 0

• mpouttu / djynn

  A pythonic FOSS expert system built by a collaboration of data engineers, devops, and analysts to automate common corporate data use cases. Pronounced "gin" as in engine.

  airflowhudikafkapysparkpython
  0

• OpenTableFormat / OpenTableFormat.github.io

  Website for open table format 🕸

  hudiicebergopentableformatdeltalake
  Language:CSS 0

• ev2900 / Glue_Hudi

  Apache Hudi examples designed to be run on AWS Glue via. Glue Jobs

  awshudiapache-hudihudi-examplesglueaws-glue
  Language:Python

• hussein-awala / stream-applications

  A repository contains some examples for stream processing applications using spark structured streaming, Kafka Streams, and some other tools like Apache Hudi...

  hudikafkakafka-connectkafka-streamssparkspark-streaming
  Language:Java