At SciPy in Austin, Texas
Mon 10 July 2023, 1:30–5:30 pm (CDT, Chicago, local time), Classroom 202
- Please also check the official Tutorial Schedule for updates.
Abstract
We will kick off this tutorial with an introduction to deep learning and highlight its primary strengths and use cases compared to traditional machine learning. In recent years, PyTorch has emerged as the most widely used deep learning library for research. However, a lot has changed regarding how we train neural networks these days. After getting a firm grasp of the PyTorch API, you will learn how to train deep neural networks using various multi-GPU training paradigms. We will also fine-tune large language models (transformers)!
Material & Preparation
The workshop material will be posted on the weekend before the event. To prepare for the workshop, there are only 3 small action items
- (Optional) You may find the Python Setup Guide (./00-1_python-setup-guide) helpful, which mainly describes how I set up Python on my computer(s).
- Please go through Python Library Installation (./00-2_python-libraries-for-workshop) guide to ensure you have all the required libraries installed prior to the workshop.
- I recommend downloading this repository before the event so you can access the materials offline in case of a slow internet connection during the workshop.
Looking forward to seeing you there!
PS: If you have any questions, please feel free to reach out via the Discussion page here on GitHub.
- Introduction to Deep Learning (1:30 - 2:00 pm) [Slides]
- Understanding the PyTorch API (2:00 - 2:30 pm) [Slides]
- Training Deep Neural Networks (2:30 - 3:00 pm) [Slides]
10 Min Break
- Accelerating PyTorch Model Training (3:10 - 3:45 pm) [Slides]
- Organizing PyTorch Code (3:45 - 4:15 pm) [Slides]
- More Tips and Techniques (4:15 - 4:45 pm) [Slides]
10 Min Break