joseph-higaki / UDataEng_L03E02_IaC-101

IaC over AWS with Python

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Overview / Purpose

Notebook to create:

  • IAM Roles
  • Attach policies to the role
  • Creating an Inbound rule to allow access to the redshift cluster endpoint
  • Connect with the postgresql client from the notebook to the redshift cluster

Solution: Infrastructure as Code

  1. Save the AWS Access key
  2. Load DWH Params from a file
  3. Create clients for IAM, EC2, S3, and Redshift
  4. Check out the sample data sources on S3
  5. Create an IAM ROLE
  6. Create the Redshift Cluster
  7. Describe the cluster to see its status
  8. Take note of the cluster endpoint and role ARN
  9. Open an incoming TCP port to access the cluster ednpoint
  10. Make sure you can connect to the cluster
  11. Clean up your resources to avoid reaching billing limits

About

IaC over AWS with Python


Languages

Language:Jupyter Notebook 95.0%Language:Batchfile 5.0%