noah-paige / aws-ddk-examples

DDK Examples

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

AWS DDK Examples

This repository contains a list of example projects for the AWS DataOps Development Kit (DDK).

Table of Contents

  1. About this Repo
  2. Examples
  3. Learning Resources
  4. License

About this Repo

This repository holds our official list of DDK examples code. They aim to showcase the different ways you can leverage the DDK to help with your DataOps workloads, including building a data pipeline to ingest SaaS data or to create your private code artifactory, for example.

We welcome contributions to this repository in the form of enhancements to existing examples or the addition of new ones. For more information on contributing, please see the CONTRIBUTING guide.

It is assumed that you are already somewhat familiar with the AWS DDK. If not, we strongly recommend that you go through our Learning Resources first, in particular the DDK workshop and documentation.

If you would like to start your journey by looking at an example, we recommend you to start with Basic Data Pipeline example from the list below.

Examples

Examples
Basic Data Pipeline
Appflow/Athena
Athena Query Execution Pipeline
Athena Views Pipeline
Private Artifactory
Cross-Account / Cross-Region Data Pipelines
Data Validation & Cataloging Pipeline
SDLF DDK Lightweight
Simple Glue Tranform
File Standardization Pipeline

Learning Resources

Beyond this repository, there are other resources that can be referenced to assist with your learning/development process.

Official Resources

License

This library is licensed under the Apache 2.0 License.

About

DDK Examples

License:Apache License 2.0


Languages

Language:Python 97.3%Language:Shell 1.7%Language:Batchfile 0.7%Language:Makefile 0.4%