This repository contains the A1 solutions of Course "Serverless Data Processing"
1. First I created the bucket with all public permissions, so I can use it freely the first time and to get it working.
2. I tried creating an IAM user and gave it programming access to connect python program to the bucket. tried creatign the first user but, it throws some error and can not create users succesfully. Then I found that, all the access ID and shared key and other credentials are provided by AWS educate on their workbench. We need to click on account details and fetch the credentials.
3. I got to know later that we need to paste all those credentials in a folder C:/users/username/.aws/credentials file, and then it worked.
4. After creating another bucket, I had to block the public access of that bucket. I searched and found about policies. I created a policy which did not work. Then I looked over the buckets in AWS and found a policy generator which helped.
5. We have to change the credentials each time we open the aws educate again.
6. I tried with policy but that did not work out. Then finally I got a function "put_public_access_block" in the s3 boto documentation which did the job.
7. I changed the ACL settings using the function "put_bucket_acl". I fetched the json file from "get_bucket_acl" and modified it so that to eliminate write access to root user as required. Then I set is using "put_bucket_acl" function.
8. Now I had to move files from one bucket to another, so I copied it from bucket1 to bucket2 and deleted from bucket1.
1. After creating the RDS database which has public accessibility, I connected it with MySQL Workbench using the endpoint,port,user,password. I added the inbound rule "0.0.0.0/0" as I was working for the first time. This is not considered secure so it is adviced to change is afterwards.
2. I created a database using Workbench and added a table "users" which contained 2 fields 1. userID, 2. Password.
3. After encrypting the password according to the lookup table, I inserted the values using python script.
4. Finally I tried to fetch the values inserted using the script
https://docs.ceph.com/docs/master/radosgw/s3/python/
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-example-creating-buckets.html
https://realpython.com/python-boto3-aws-s3/#creating-a-bucket