KarinSchork / Machine-Learning-with-Python

Practice and tutorial-style notebooks covering wide variety of machine learning techniques

Python Machine Learning Jupyter Notebooks (ML website)

Dr. Tirthajyoti Sarkar, Fremont, California (Please feel free to connect on LinkedIn here)

---

Also check out these super-useful Repos that I curated

• Highly cited and useful papers related to machine learning, deep learning, AI, game theory, reinforcement learning

• Carefully curated resource links for data science in one place

Requirements

• Python 3.6+
• NumPy (pip install numpy)
• Pandas (pip install pandas)
• Scikit-learn (pip install scikit-learn)
• SciPy (pip install scipy)
• Statsmodels (pip install statsmodels)
• MatplotLib (pip install matplotlib)
• Seaborn (pip install seaborn)
• Sympy (pip install sympy)
• Flask (pip install flask)
• WTForms (pip install wtforms)
• Tensorflow (pip install tensorflow>=1.15)
• Keras (pip install keras)
• pdpipe (pip install pdpipe)

---

You can start with this article that I wrote in Heartbeat magazine (on Medium platform):

"Some Essential Hacks and Tricks for Machine Learning with Python"

Essential tutorial-type notebooks on Pandas and Numpy

Jupyter notebooks covering a wide range of functions and operations on the topics of NumPy, Pandans, Seaborn, Matplotlib etc.

• Detailed Numpy operations
• Detailed Pandas operations
• Numpy and Pandas quick basics
• Matplotlib and Seaborn quick basics
• Advanced Pandas operations
• How to read various data sources
• PDF reading and table processing demo
• How fast are Numpy operations compared to pure Python code? (Read my article on Medium related to this topic)
• Fast reading from Numpy using .npy file format (Read my article on Medium on this topic)

Tutorial-type notebooks covering regression, classification, clustering, dimensionality reduction, and some basic neural network algorithms

Regression

• Simple linear regression with t-statistic generation

• Multiple ways to perform linear regression in Python and their speed comparison (check the article I wrote on freeCodeCamp)

• Multi-variate regression with regularization

• Polynomial regression using scikit-learn pipeline feature (check the article I wrote on Towards Data Science)

• Decision trees and Random Forest regression (showing how the Random Forest works as a robust/regularized meta-estimator rejecting overfitting)

• Detailed visual analytics and goodness-of-fit diagnostic tests for a linear regression problem

• Robust linear regression using HuberRegressor from Scikit-learn

---

Classification

• Logistic regression/classification (Here is the Notebook)

• k-nearest neighbor classification (Here is the Notebook)

• Decision trees and Random Forest Classification (Here is the Notebook)

• Support vector machine classification (Here is the Notebook) (check the article I wrote in Towards Data Science on SVM and sorting algorithm)

• Naive Bayes classification (Here is the Notebook)

---

Clustering

• K-means clustering (Here is the Notebook)

• Affinity propagation (showing its time complexity and the effect of damping factor) (Here is the Notebook)

• Mean-shift technique (showing its time complexity and the effect of noise on cluster discovery) (Here is the Notebook)

• DBSCAN (showing how it can generically detect areas of high density irrespective of cluster shapes, which the k-means fails to do) (Here is the Notebook)

• Hierarchical clustering with Dendograms showing how to choose optimal number of clusters (Here is the Notebook)

---

Dimensionality reduction

• Principal component analysis

---

Deep Learning/Neural Network

• Demo notebook to illustrate the superiority of deep neural network for complex nonlinear function approximation task
• Step-by-step building of 1-hidden-layer and 2-hidden-layer dense network using basic TensorFlow methods

---

Random data generation using symbolic expressions

• How to use Sympy package to generate random datasets using symbolic mathematical expressions.

• Here is my article on Medium on this topic: Random regression and classification problem generation with symbolic expression

---

Synthetic data generation techniques

• Notebooks here

Simple deployment examples (serving ML models on web API)

• Serving a linear regression model through a simple HTTP server interface. User needs to request predictions by executing a Python script. Uses Flask and Gunicorn.

• Serving a recurrent neural network (RNN) through a HTTP webpage, complete with a web form, where users can input parameters and click a button to generate text based on the pre-trained RNN model. Uses Flask, Jinja, Keras/TensorFlow, WTForms.

---

Object-oriented programming with machine learning

Implementing some of the core OOP principles in a machine learning context by building your own Scikit-learn-like estimator, and making it better.

See my articles on Medium on this topic.

• Object-oriented programming for data scientists: Build your ML estimator
• How a simple mix of object-oriented programming can sharpen your deep learning prototype

---

Unit testing ML code with Pytest

Check the files and detailed instructions in the Pytest directory to understand how one should write unit testing code/module for machine learning models

---

Memory and timing profiling

Profiling data science code and ML models for memory footprint and computing time is a critical but often overlooed area. Here are a couple of Notebooks showing the ideas,

• Memory profling using Scalene
• Time-profiling data science code