zejuanxiaoyu / reinforcement_learning_specialisation_notes

Notes from Reinforcement Learning Specialisaiton

Introduction to Reinforcement Learning Notes

My notes from the Reinforcement Learning Specialization from Coursera and the University of Alberta.

They all include pretty $\LaTeX$ formulae.

If above you see $\LaTeX$ and not pretty formatted text, I recommend this Chrome extension.

I have lifted text and formulae liberally from the sources listed at the top of the course 1, week 1 notes.

1. Fundamentals of Reinforcement Learning

• Week 1 - $K$-armed bandits
• Week 2 - Markov Decision Processes
• Week 3 - Value functions and Bellman Equations
• Week 4 - Optimal Policies with Dynamic Programming

2. Sample-based Learning Methods

• Weeks 1 & 2 - Welcome; Monte Carlo Methods for Prediction & Control
• Week 3 - Temporal Difference Learning Methods for Prediction [WIP]
• Week 4 - Temporal Difference Learning Methods for Control [Not yet started]
• Week 5 - Planning, Learning and Acting [Not yet started]