danielblazevski / airflow-pyspark-reddit

Example of using Airflow to schedule downloading data form S3 and launching spark jobs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

airflow-pyspark-reddit

Example of using Airflow to schedule downloading data form S3 and launching spark jobs

About

Example of using Airflow to schedule downloading data form S3 and launching spark jobs


Languages

Language:Python 100.0%