theNeo39 / learning_data_engineering

All resources looked in the process of Data Engineer

Resources for Data Engineering

General

• Push vs Pull strategy
• Docker
• YAML as config file
• pipenv Y so?
• Logging

RDBMS

• RDBMS Course for DQL
• RDBMS course for data modeling, DDL & DML
• PostgreSQL
• PL/pgsql
• Normalization
• Indexing
• SQL Window Functions [1] [2]

NoSQL

• Types of NoSQL Databases
• ACID vs CAP
• Row vs Column Oriented Databases
• HBase vs Cassandra [1] [2]
• Apache Cassandra
  1. DataStax Course
  2. Tutorial
  3. Application Ex.
• MongoDB
  1. Basic Tutorial
  2. Reading: [1]

Hadoop

1. Itversity Data Engineering Bootcamp
2. Yandex HDFS & Spark Fundamentals
3. Small files problem in Hadoop
4. Hadoop The Definitive Guide Book

Spark

• Spark The Definitive Guide
• Spark File InputSplit/Partition/Coalesce [1] [2] [3]
• Timestamp/Timezone with Parquet Files [1] [2] [3]
• Spark Joins [1]
• Itversity Spark Tutorials

Kafka

• Tutorial