Introduction to Language Modeling with BERT, GPT3, and more!
This repository contains materials for our class on language modeling.
To use the code, clone the repository and install the required packages specified in the requirements.txt file. The code has been tested with Python 3.7 and above.
Lesson 1: Intro to LLMs and Getting Started with BERT
Slides
Code
Lesson 2: Querying Conversations with FLAN-T5
Mapping out a prototype with a mind for production
Slides
Code
Lesson 3: Introduction to OpenAI
Slides
Code
Lesson 4: Advanced OpenAI Usage
Data
Sample OpenAI Fine-tuning data