alandrummonds

azure-blob-to-s3

Batch copy files from Azure Blob Storage to Amazon S3

rony

Data Engineering made simple - An opinionated Data Engineering framework

RStoolKit

RStoolKit - A utility to perform a complete health check of your AWS RedShift Cluster

data-engineer-roadmap

Roadmap to becoming a data engineer in 2021

amazon-kinesis-connectors

amazon-deequ-glue

Automated data quality suggestions and analysis with Deequ on AWS Glue

developer-roadmap

Interactive roadmaps, guides and other educational content to help developers grow in their careers.

aws-big-data-blog

sistemas-dinamicos

amazon-redshift-utils

Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

amazon-kinesis-producer

Amazon Kinesis Producer Library

deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

public-apis

A collective list of free APIs

amundsen

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

spark-sql-internals

The Internals of Spark SQL

Pokedex

🗡️ Pokedex demonstrates modern Android development with Hilt, Material Motion, Coroutines, Flow, Jetpack (Room, ViewModel) based on MVVM architecture.

aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Cookbook

The Data Engineering Cookbook

aws-research-workshops

This repo provides a managed SageMaker jupyter notebook with a number of notebooks for hands on workshops in data lakes, AI/ML, Batch, IoT, and Genomics.

content-aws-bigdata-cert

kafka-beginner-learnings

https://github.com/simplesteph/kafka-beginners-course

great_expectations

Always know what to expect from your data.

Apache-nifi-links

Spark-The-Definitive-Guide

Spark: The Definitive Guide's Code Repository

aws-shell

An integrated shell for working with the AWS CLI.

awesome-nifi

A list of useful Apache NiFi resources, processor bundles and tools

happybase

A developer-friendly Python library to interact with Apache HBase

Starbucks-Location-Mapping

cerebro

aws-sam-cli

CLI tool to build, test, debug, and deploy Serverless applications using AWS SAM