ritchieng / deep-learning-wizard

Open source guides/codes for mastering deep learning to deploying deep learning in production in PyTorch, Python, Apptainer, and more.

Deep Learning Materials by Deep Learning Wizard

Start Learning Now

Please head to www.deeplearningwizard.com to start learning! It is mobile/tablet friendly and open-source.

Repository Details

This repository contains all the notebooks and mkdocs markdown files of the tutorials covering machine learning, deep learning, deep reinforcement learning, data engineering, general programming, and visualizations powering the website.

Take note this is an early work in progress, do be patient as we gradually upload our guides.

Sections and Subsections

• Deep Learning and Deep Reinforcement Learning Tutorials (Libraries: Python, PyTorch, Gym, NumPy, Matplotlib and more)

  • Introduction
  • Course Progression
  • Practical Deep Learning with PyTorch
    • Matrices
    • Gradients
    • Linear Regression
    • Logistic Regression
    • Feedforward Neural Network (FNN)
    • Convolutional Neural Network (CNN)
    • Recurrent Neural Network (RNN)
    • Long Short-Term Memory Network (LSTM)
    • Autoencoders (AE)
    • Fully Connected Overcomplete Autoencoders
  • Improving Deep Learning with PyTorch
    • Derivative, Gradient and Jacobian
    • Forward- and Backward-propagation and Gradient Descent (From Scratch FNN Regression)
    • Learning Rate Scheduling
    • Optimization Algorithms
    • Weight Initialization and Activation Functions
  • Deep Reinforcement Learning with PyTorch
    • Supervised to Reinforcement Learning
    • Markov Decision Processes and Bellman Equations
    • Dynamic Programming
  • From Scratch Deep Learning with PyTorch/Python
    • From Scratch Logistic Regression Classification
  • Compute Optimization
    • Speed Optimization Basics Numba

• Language Models (Libraries: Python, Pytorch, Ollama, LlamaIndex, CUDA, Huggingface, Apptainer)

  • Intro
  • Containers
    • HPC Containers with Apptainer
  • Language Models
    • LLM Introduction & Hyperparameter Tuning
  • Multi-Modal Language Models
    • MMLM Introduction
  • Retrieval Augemented Generation (RAG)
    • Embeddings Introduction

• Machine Learning Tutorials (Libraries: Python, cuDF RAPIDS, cuML RAPIDS, pandas, numpy, scikit-learn and more)

  • RAPIDS cuDF
    • Intro
    • GPU DataFrames
    • CPU/GPU Fractional Differencing

• Programming Tutorials (Libraries: C++, Python, Bash and more)

  • Intro
  • C++
  • Bash
  • Python
  • Javascript
  • Electron

• Data Engineering Tutorials (Libraries: Bash, Databricks, Delta Live Tables, Parquet, Python, Cassandra, and more)

  • Cassandra (NoSQL)
    • Introduction
    • Apache Cassandra Cluster Setup

About Deep Learning Wizard

We deploy a top-down approach that enables you to grasp deep learning theories and code easily and quickly. We have open-sourced all our materials through our Deep Learning Wizard Wikipedia. For visual learners, feel free to sign up for our video course and join thousands of deep learning wizards.

To this date, we have taught thousands of students across more than 120+ countries.

Contribution

We are openly calling people to contribute to this repository for errors. Feel free to create a pull request.

Main Contributor

Ritchie Ng

Editors and Supporters

• Jie Fu, Editor (Postdoc in Montreal Institute for Learning Algorithms (MILA))
• Alfredo Canziani, Supporter (Assistant Prof in NYU under Yann Lecun)
• Marek Bardonski, Supporter (Managing Partner, AIRev)

Bugs and Improvements

Feel free to report bugs and improvements via issues. Or just simply try to pull to make any improvements/corrections.

Social Media

• Youtube
• Twitter
• Facebook
• Linkedin

Citation

If you find the materials useful, like the diagrams or content, feel free to cite this repository.