end-to-end-data-engineering

There are 0 repository under end-to-end-data-engineering topic.

• / RedditDataEngineering

  This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data warehouse. The pipeline leverages a combination of tools and services including Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.

  apache-airflowawscelerydata-pipelineredditend-to-end-data-engineering
  Language:Python 41

• / ApacheFlink-SalesAnalytics

  This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project demonstrates how to ingest, process, and analyze sales data, showcasing the capabilities of Apache Flink for big data processing.

  apache-flinkdata-engineeringend-to-end-data-engineeringsales-analytics
  Language:Java 7