dedds001 / Data_Pipeline

create a data pipeline to move data from oracle sql developer to an AWS S3 bucket and snowflake database

Data_Pipeline

Prepare a Data Pipeline based in aforesaid diagram. Do following steps

1. Extract the data from Oracle RDS instance

2. Upload the data to your S3 bucket using Python ( or using Postman )

3. Import the data into Snowflake from the s3 bucket

4. Write the queries from Oracle/SQL assignments.

5. Output of queries ( whichever query generates output ) export into S3 from Snowflake

6. Create a basic data Visualization ( graphs ) using the data available on s3 from step 5.

7. Publish the whole code into Github.

View the steps in databricks notebook: https://databricks-prod-cloudfront.cloud.databricks.com/public/4027ec902e239c93eaaa8714f173bcfc/1454017710891412/1008713947465588/8419640203592435/latest.html