This repository contains the lecture materials for EECS 545, a graduate course in Machine Learning, at the University of Michigan, Ann Arbor.
The link above gives a list of all of the available lecture materials, including links to ipython notebooks (via Jupyter's nbviewer), the slideshow view, and PDFs.
We will make references to the following textbooks throughout the course. The only required textbook is Bishop, PRML, but the others are very well-written and offer unique perspectives.
- Bishop 2006, Pattern Recognition and Machine Learning
- Murphy 2012, Machine Learning: A Probabilistic Perspective
Wednesday, January 6, 2016
No required reading.
Monday, January 11, 2016
- There are lots of places to look online for linear algebra help!
- Juan Klopper has a nice online review, based on Jupyter notebooks.
Wednesday, January 13, 2016 (Notebook Viewer, PDF File, Slide Viewer)
Required:
- Bishop, §1.2: Probability Theory
- Bishop, §2.1-2.3: Binary, Multinomial, and Normal Random Variables
Optional:
- Murphy, Chapter 2: Probability
Wednesday, January 20, 2016 (Notebook Viewer, PDF File, Slide Viewer)
Required:
- Bishop, §1.1: Polynomial Curve Fitting Example
- Bishop, §3.1: Linear Basis Function Models
Optional:
- Murphy, Chapter 7: Linear Regression
Monday, January 25, 2016 (Notebook Viewer, PDF File, Slide Viewer)
Required:
- Bishop, §3.2: The Bias-Variance Decomposition
- Bishop, §3.3: Bayesian Linear Regression
Optional:
- Murphy, Chapter 7: Linear Regression
Wednesday, January 27, 2016 (Notebook Viewer, PDF File, Slide Viewer)
Required:
- Bishop, §4.2: Probabilistic Generative Models
- Bishop, §4.3: Probabilistic Discriminative Models
Optional:
- Murphy, Chapter 8: Logistic Regression
Monday, February 1, 2016 (Notebook Viewer, PDF File, Slide Viewer)
Required:
- Bishop, §4.1: Discriminant Functions
Recommended:
- Murphy §3.5: Naive Bayes Classifiers
- Murphy §4.1: Gaussian Models
- Murphy §4.2: Gaussian Discriminant Analysis
Optional:
- CS 229: Notes on Generative Models
- Paper: Zhang, H., 2004. "The optimality of naive Bayes". AA, 1(2), p.3.
- Paper: Domingos, P. and Pazzani, M., 1997. "On the optimality of the simple Bayesian classifier under zero-one loss". Machine learning, 29(2-3), pp.103-130.
Monday, February 8, 2016
Required:
- Bishop, §6.1: Dual Representation
- Bishop, §6.2: Constructing Kernels
- Bishop, §6.3: Radial Basis Function Networks
Optional:
- Murphy, §14.2: Kernel Functions
Wednesday, February 10, 2016
Required:
- Bishop, §6.1: Dual Representation
- Bishop, §6.3: Radial Basis Function Networks
- Bishop, §7.1: Maximum Margin Classifiers
Optional:
- CS229: Support Vector Machines
- Eric Kim, Everything You Wanted to Know about the Kernel Trick (But were too Afraid to Ask)
Monday, February 15, 2016
Required:
- Bishop, §2.3.0-2.3.1: Gaussian Distributions
- Bishop, §3.3: Bayesian Linear Regression
- Bishop, §6.4: Gaussian Processes
Recommended:
- Murphy, §7.6.1-7.6.2: Bayesian Linear Regression
- Murphy, §4.3: Inference in Joinly Gaussian Distributions
Further Reading:
- Rasmussen & Williams, Gaussian Processes for Machine Learning. (available free online)
Wednesday, February 17, 2016
No required reading.