State of GPT | BRK216HFS
Microsoft DeveloperYouTube ↗
Archive guide
Andrej Karpathy walks through how GPT assistants are trained, from tokenization and pretraining to supervised finetuning and RLHF, and gives practical prompting strategies and a view of the tooling ecosystem.