Loading…

H(p) = −Σ pᵢ log pᵢperplexity = eᴴKV ≈ 2 · L · d · bytes / token

juniorWhat does temperature change?

softmax(QKᵀ/√d)·VFLOPs / byte

Sign in to save your progress

Everything here is free. An account unlocks every lesson and keeps your progress and review.

41 lessons · 296 topics · 492 interview questions

EmailPassword

New here?

or continue with

pᵢ ∝ exp(zᵢ / T)492 questions