ak123's repositories
Airflow_Songify_DataEngineering
Use Airflow to create and update a Redshift Data Lake
arthur-redshift-etl
ELT Code for your Data Warehouse
awesome-data-engineering
A curated list of data engineering tools for software developers
aws-data-wrangler
Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
AWS-S3-GLUE-REDSHIFT
automation of ETL
aws-sct-user-guide
The open source version of the AWS Schema Conversion Tool docs. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.
awsdatamigration
AWS Database Migration: In this workshop, I explored how to migrate the data from database using the AWS Database Migration Service (DMS) and AWS Schema Conversion Tool (AWS SCT)
Data-Engineering-with-AWS
Data Engineering with AWS, Published by Packt
dataform
Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
datawarehouse-Redshift-ETL
Building a python etl to load data from s3 to redshift clsuters
DW-Migration-to-Redshift-using-SCT
Data Warehouse Migration to Amazon Redshift using AWS SCT
dwh-redshift
ETL pipeline for a DWH hosted on Redshift
ETL-Project
Redshift Queries, Redshift Setup, Spark ETL Codes, Sqoop Dataingestion
etl_redshift_songplay
ETL Project using AWS RedShift
gsutil
A command line tool for interacting with cloud storage services.
hans-redshift-etl
ETL for Redshift.
redshift-datawarehouse-etl
Creating a data-warehouse ETL process in Redshift utilizing song and user data from a fake music streaming service (Project for the Udacity Data Engineering Nanodegree).
redshift-query
This is a very simple library that gets credentials of a cluster via redshift.GetClusterCredentials API call and then makes a connection to the cluster and runs the provided SQL statements.
Redshift_ETLFW
ETL framework for Amazon Redshift using its Federated Query feature
redswitch
Allows the use of Redshift with automatic position updating, without the complexity of GeoClue
rs-streamloader
Redshift Loading Tool (ETL) - receives readable streams and Copies to Redshift (upsert or insert) via S3
sparkify-etl-redshift
Data Warehouse project using AWS Redshift for Udacity's Data Engineering Nanodegree
sparkify-redshift-etl
ETL Pipeline from AWS S3 to Redshift
starlake
Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing