※ The scripts are from the last section of Fastcampus Data Engineering course, yet I, of course, typed and reviewed all the scripts for my understanding.
This is my first data engineering project with data pipeline example of Facebook Artist Chatbot Application. The chatbot provides top tracks and genres of the global artists through Spotify API in real time.
| Type | Details |
|---|---|
| Language | Python 3.7, Shell |
| Storage | AWS S3, EC2 |
| RDBMS | AWS RDS (MySQL) |
| NoSQL | AWS DynamoDB |
| OS | Ubuntu 14.05 (AWS EC2), Windows 10 |
| API Call | AWS Lambda |
| Log Monitoring | AWS Cloud Watch |
| API Service | AWS API Gateway |
| Library | Pymysql, boto3, json, etc |
| Data Source | Spotify API |
- Facebook Chatbot (Client)
- Artist 이름을 챗봇에 입력한다.
- AWS Lambda Function
- RDS와 DynamoDB의 차이점
그 외의 issues
- Due to Covid-19, Facebook currently has paused to review and approve the apps for individual uses.