Learn about the training pipeline of GPT assistants like ChatGPT, from tokenization to pretraining, supervised finetuning, and Reinforcement Learning from Human Feedback (RLHF). Dive deeper into practical techniques and mental models for the effective use of these models, including prompting strategies, finetuning, the rapidly growing ecosystem of tools, and their future extensions.
Speakers:
- Andrej Karpathy
Session Information: This video is one of many sessions delivered for the Microsoft Build 2023 event. View the full session schedule and learn more about Microsoft Build at https://build.microsoft.com
BRK216HFS | English (US) | AI
#MSBuild
chatgpt, openai, gpt4, microsoft openai, Andrej Karpathy, AI, artificial intelegance