Artificial Intelligence Engineer Roadmap

Overview

This is resources for going from software engineer/non-software engineer to profressional in AI engineer.

About Me

I'm a Thai Software Engineer who is really passionate to become entrepreneur, investor, and AI engineer. Was found Humaan.ai to bringing the AI to everyone to do incredible ways.

Currently, I'm studying for a master's degree in Business Analytics and Data Sciences, where majoring in Artificial Intelligence and Machine Learning at National Institute of Development Administration (NIDA), Thailand.

Connect with me at Linkedin · Twitter · Facebook · GitHub

What Exactly Does an AI Engineer Do
Part I: Artificial Intelligence
- Chapter 1: Intro to Artificial Intelligence
  - What is Artificial Intelligence?
  - The History of Artificial Intelligence
Part II: Problem-solving
Part III: Knowledge, reasoning, and planning
Part IV: Uncertain knowledge and reasoning
Part V: Learning
Part VI: Communicating, perceiving, and acting
Appendix A: Rockstars of the AI Research and AI Engineering World
Appendix B: Resources
Appendix C: Online Courses

1. Mathematics

Linear Algebra
- Scalars
- Vectors
- Matrices
- Tensors
Probability and Information Theory
Numerical Computation
Hidden Markov Models

2. Statistics

3. Computer Science

Python Fundamentals

Python Basics
Flow Control
Data Structures
Functions
Files and the Operating System

Python for Data Analysis (Pandas, NumPy)

Bonus

Exploratiory Data Analysis and Data Visualization

Online courses

Computer Science and Data Science

Introduction to Computer Science and Programming in Python : Introduction to Computer Science and Programming in Python is intended for students with little or no programming experience. It aims to provide students with an understanding of the role computation can play in solving problems and to help students, regardless of their major, feel justifiably confident of their ability to write small programs that allow them to accomplish useful goals. The class uses the Python 3.5 programming language.
Introduction to Computational Thinking and Data Science : The continuation of "Introduction to Computer Science and Programming in Python" and is intended for students with little or no programming experience. It aims to provide students with an understanding of the role computation can play in solving problems and to help students, regardless of their major, feel justifiably confident of their ability to write small programs that allow them to accomplish useful goals.
Introduction to Algorithms : This course provides an introduction to mathematical modeling of computational problems. It covers the common algorithms, algorithmic paradigms, and data structures used to solve these problems. The course emphasizes the relationship between algorithms and programming, and introduces basic performance measures and analysis techniques for these problems.

Mathematics

Introduction to Probability and Statistics : This course provides an elementary introduction to probability and statistics with applications. Topics include: basic combinatorics, random variables, probability distributions, Bayesian inference, hypothesis testing, confidence intervals, and linear regression.
Linear Algebra : This is a basic subject on matrix theory and linear algebra. Emphasis is given to topics that will be useful in other disciplines, including systems of equations, vector spaces, determinants, eigenvalues, similarity, and positive definite matrices.
Mathematics of Machine Learning : Broadly speaking, Machine Learning refers to the automated identification of patterns in data. As such it has been a fertile ground for new statistical and algorithmic developments. The purpose of this course is to provide a mathematically rigorous introduction to these developments with emphasis on methods and their analysis.

Math for Machine Learning

Linear Algebra

Topics include Vector spaces, Matrix vector operations, Rank of a matrix, Norms, Eigenvectors and values and a bit of Matrix calculus too.

Probability & Statistics

Topics include Random variables, expectation, Probability distributions and so on.

Calculus

Topics include Limits, Derivatives, Implicit differentiation, Finding extrema, MVT, Newton's method and Integral calc stuff. The advanced materials are about Matrix calculus - Gradients, Directional derivatives etc.

Aritificial Intelligence

Intro to AI : Lecture and course materials for UC Berkeley CS188 Intro to AI
Artificial Intelligence - MIT : This course introduces students to the basic knowledge representation, problem solving, and learning methods of artificial intelligence.
Techniques in Artificial Intelligence (SMA 5504) : Topics covered include: representation and inference in first-order logic, modern deterministic and decision-theoretic planning techniques, basic supervised learning methods, and Bayesian network inference and learning.

Natural Language Processing

Natural Language Processing — Stanford University by Dan Jurafsky
Natural Language Processing Specialization : Break into the NLP space. Master cutting-edge NLP techniques through four hands-on courses!
Stanford's Natural Language Processing with Deep Learning (CS224n) : Natural language processing (NLP) is a crucial part of artificial intelligence (AI), modeling how people share information. In recent years, deep learning approaches have obtained very high performance on many NLP tasks. In this course, students gain a thorough introduction to cutting-edge neural networks for NLP.

Machine Learning

Machine Learning by Andrew Ng: This course provides a broad introduction to machine learning, datamining, and statistical pattern recognition. Topics include: (i) Supervised learning (parametric/non-parametric algorithms, support vector machines, kernels, neural networks). (ii) Unsupervised learning (clustering, dimensionality reduction, recommender systems, deep learning). (iii) Best practices in machine learning (bias/variance theory; innovation process in machine learning and AI). The course will also draw from numerous case studies and applications, so that you'll also learn how to apply learning algorithms to building smart robots (perception, control), text understanding (web search, anti-spam), computer vision, medical informatics, audio, database mining, and other areas.
Machine Learning - MIT: an introductory course on machine learning which gives an overview of many concepts, techniques, and algorithms in machine learning, beginning with topics such as classification and linear regression and ending up with more recent topics such as boosting, support vector machines, hidden Markov models, and Bayesian networks.
Machine Learning for Healthcare: This course introduces students to machine learning in healthcare, including the nature of clinical data and the use of machine learning for risk stratification, disease progression modeling, precision medicine, diagnosis, subtype discovery, and improving clinical workflows.
CS 329S: Machine Learning Systems Design: This course aims to provide an iterative framework for designing real-world machine learning systems. The goal of this framework is to build a system that is deployable, reliable, and scalable.

Deep Learning

Introduction to Deep Learning: This is MIT's introductory course on deep learning methods with applications to computer vision, natural language processing, biology, and more! Students will gain foundational knowledge of deep learning algorithms and get practical experience in building neural networks in TensorFlow.
Deep Learning Specialization by Andrew Ng: Become a Deep Learning experts. Master Deep Learning and Break into AI
Deep Reinforcement Learning: Lectures for UC Berkeley CS 285: Deep Reinforcement Learning.
Deep Learning for Computer Vision: Lecture for Michigan University EECS 498-007/598-005 Deep Learning for Computer Vision
Introduction to Deep Learning-Spring 2021, Carnegie Mellon University : This course we will learn about the basics of deep neural networks, and their applications to various AI tasks.
Full Stack Deep Learning-Spring 2021, UC Berkeley: Full Stack Deep Learning helps you bridge the gap from training machine learning models to deploying AI systems in the real world.
NYU’s Deep Learning: This course concerns the latest techniques in deep learning and representation learning, focusing on supervised and unsupervised deep learning, embedding methods, metric learning, convolutional and recurrent nets, with applications to computer vision, natural language understanding, and speech recognition.

Open Source Learning Projects

Computer Vision

Motion Heatmap Using OpenCV in Python: This sample application is useful to see movement patterns over time. For example, it could be used to see the usage of entrances to a factory floor over time, or patterns of shoppers in a store.
Few-Shot vid2vid by NVIDIA: Pytorch implementation for few-shot photorealistic video-to-video translation. It can be used for generating human motions from poses, synthesizing people talking from edge maps, or turning semantic label maps into photo-realistic videos. The core of video-to-video translation is image-to-image translation. Some of our work in that space can be found in pix2pixHD and SPADE.
Gaussian YOLOv3: An Accurate and Fast Object Detector for Autonomous Driving : Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Driving (ICCV, 2019)
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Natural Language Processing

T5: Text-To-Text Transfer Transformer : Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Machine Learning

Homemade Machine Learning: Python examples of popular machine learning algorithms with interactive Jupyter demos and math being explained

Books

Mathematics