bluishglc / glue-hudi-integration-example

An example project to demo how Glue read and write hudi dataset, and also sync metadata to Glue Catalog.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

glue-hudi-integration-example

An example project to demo how Glue read and write hudi dataset, and also sync metadata to Glue Catalog.

There is a specific artical 在AWS Glue中使用Apache Hudi about this project which give detailed comments about how to integrate AWS Glue and Apache Hudi. Actually, this project is demo program for this artical.

This programe is based on Glue 2.0 and Hudi 0.8.0.

About

An example project to demo how Glue read and write hudi dataset, and also sync metadata to Glue Catalog.


Languages

Language:Scala 100.0%