← CurriculumPractise these
Module 01 · Draft
Model Foundations
Tokenization, embeddings, attention, sampling, context windows, and the KV cache.
- Lessons
- 6
- Topics
- 46
- Minutes
- 134
Lessons
- Lesson 1Tokenization: From Text to Token IDs18 min · 8 topics · beginner
- Lesson 2Embeddings: From Token IDs to Vectors20 min · 8 topics · beginner
- Lesson 3Attention: How Tokens Use Their Context22 min · 8 topics · beginner
- Lesson 4Next-Token Prediction and Sampling22 min · 8 topics · beginner
- Lesson 5Context Windows, Prefill and the KV Cache22 min · 7 topics · beginner
- Lesson 6Hallucination and the Limits of Next-Token Prediction30 min · 7 topics · beginner
Interview prep
79 questions on this module's topics.