nadiiia / AWS-Load-New-Partitions-Programmatically

To have a python script to compare the Athena metadata with the S3 data structure and add the new partitions without having the overhead of scanning all the files in the bucket.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

AWS-Load-New-Partitions-Programmatically

To have a python script to compare the Athena metadata with the S3 data structure and add the new partitions without having the overhead of scanning all the files in the bucket.

About

To have a python script to compare the Athena metadata with the S3 data structure and add the new partitions without having the overhead of scanning all the files in the bucket.


Languages

Language:Python 100.0%