# Attention head

> Attention head: One independent attention computation. Models run many heads in parallel, each free to look for a different relationship.

Canonical: https://llmdojo.dev/glossary/attention-head

Also called attention heads.

One independent attention computation. Models run many heads in parallel, each free to look for a different relationship.

Learn it in the lesson: [Many heads, real weights](https://llmdojo.dev/learn/model-foundations/attention/many-heads) (Model Foundations · Attention: How Tokens Use Their Context).

## Related
- [Attention](https://llmdojo.dev/glossary/attention)
- [Query, key and value](https://llmdojo.dev/glossary/qkv)
- [Causal mask](https://llmdojo.dev/glossary/causal-mask)
- [Softmax](https://llmdojo.dev/glossary/softmax)
- [Transformer block](https://llmdojo.dev/glossary/transformer-block)
- [Residual connection](https://llmdojo.dev/glossary/residual-connection)
- [Layer norm](https://llmdojo.dev/glossary/layer-norm)
- [Feed-forward network (MLP)](https://llmdojo.dev/glossary/mlp)
- [Glossary of every term](https://llmdojo.dev/glossary)