fwang2 / ML

A set of machine learning notes

Machine Learning Notes

This repository contains several study notes on Machine Learning.

Running environment

conda create --name deep python=python38
conda install jupyter
pip install -U \
    tensorflow keras scikit-learn matplotlib \
conda install pytorch torchvision -c pytorch # check pytorch page for instrucutions

Regression

• Linear Regression
• Linear Regression using PyTorch
• Logistic Regression using PyTorch

Dimension Reduction

• Single Value Decomposition

Clustering

• Hierarchical Clustering
• K-means Clustering
• DBSCAN

Deep Learning

• Gradient Descent
• Compute Graph, Back Propagation
• Neural Network Concept
• 2-Layer Gradient Descent
• 3-Layer Gradient Descent
• Regularization and dropout
• Activation Functions
  • Look into softmax and cross-entropy in PyTorch context
• CNN
• RNN and LSTM
• Transferred Learning
• Federated Learning

Scalable Learning

• Running Jupyter on Summit

Tools

• numpy, matplotlib
• Customized data loader
• Linear Algebra Review