This course provides a basic fundamental of big data architecture and management. Students will learn the big data processes and the current big data technologies that are available. Further, students will be exposed to the big data platform ecosystem for big data manipulation. The big data management will be explored for the best practice in managing and manipulating large amount of data. At the end of the course, students should be able to understand the architecture and management of big data and also can develop simple application of big data handling using particular platform in assignment.
- Understand the technology for managing, processing and manipulating large amount of data.
- Design big data platform demonstrating the implementation of big data applications.
- Discuss current technology that support for sustainability of the big data platform ecosystem.
- AWS Academy Cloud Foundations
- AWS Academy Cloud Architecting
- AWS Academy Data Engineering
- AWS Academy Machine Learning for Natural Language Processing
| Week | Topic |
|---|---|
| 1 | Introduction to Big Data and Big Data Analytics - Fundamentals and concepts of big data |
| 2 | Big Data Processing and Technology - Batch, real-time, and streaming processing. - Scalability, storage, sourcing challenges. |
| 3-4 | - ACID, BASE, and CAP theorem - Distributed File Processing & Map Reduce Processing |
| 5 | - Lambda Architecture |
| 6-7 | Relational Database (RDBMS) - Relational Data Modelling - Database design phases |
| 8 | Relational Database (RDBMS) - SQL programming (DDL, DML, CRUD Operation) |
| 9 | Relational Database (RDBMS) - SQL programming (Subqueries, Join Tables, Aggregate) |
| 10 | No SQL Database - Introduction to No SQL database - Semi-structured data Modelling (Key Value, Column Family, Document, and Graph) |
| 11-12 | No SQL database (Document-based Database) - Document-based data modelling - MongoDB query language |
| 13-14 | Cloud Technology - Introduction to Cloud - AWS Cloud (via AWS Learning Management System) |
| 15 | Project Presentation |
Please create an Issue for any improvements, suggestions or errors in the content.
You can also contact me using Linkedin for any other queries or feedback.