# Position embedding

> Position embedding: A vector added to each token's embedding so the model knows where the token sits in the sequence.

Canonical: https://llmdojo.dev/glossary/position-embedding

Also called position embeddings.

A vector added to each token's embedding so the model knows where the token sits in the sequence.

Learn it in the lesson: [How a model knows order](https://llmdojo.dev/learn/model-foundations/context/how-a-model-knows-order) (Model Foundations · Context Windows, Prefill and the KV Cache).

## Related
- [Context window](https://llmdojo.dev/glossary/context-window)
- [Prefill](https://llmdojo.dev/glossary/prefill)
- [Decode](https://llmdojo.dev/glossary/decode)
- [KV cache](https://llmdojo.dev/glossary/kv-cache)
- [Glossary of every term](https://llmdojo.dev/glossary)