# Inter-token latency

> Inter-token latency: The gap between two consecutive output tokens. Its average is the time per output token.

Canonical: https://llmdojo.dev/glossary/itl

Also called inter-token latencies.

The gap between two consecutive output tokens. Its average is the time per output token.

Learn it in the lesson: [Measuring a stream](https://llmdojo.dev/learn/inference-optimization/measuring-inference/measuring-a-stream) (Inference and Model Optimization · Measuring Inference: Latency, Throughput and Goodput).

## Interview questions about Inter-token latency

- [How do you get TTFT, inter-token latency, TPOT and total latency from one streamed reply?](https://llmdojo.dev/interview/q/how-do-you-get-ttft-inter-token-latency-tpot-and-total-latency)
- [Design optimised inference pipelines, and tell me how you would benchmark them.](https://llmdojo.dev/interview/q/design-optimised-inference-pipelines-and-tell-me-how-you-would-benchmark-them)

## Related
- [Time to first token (TTFT)](https://llmdojo.dev/glossary/ttft)
- [Time per output token (TPOT)](https://llmdojo.dev/glossary/tpot)
- [Percentile (p50, p99)](https://llmdojo.dev/glossary/percentile)
- [Throughput](https://llmdojo.dev/glossary/throughput)
- [Goodput](https://llmdojo.dev/glossary/goodput)
- [Service level objective (SLO)](https://llmdojo.dev/glossary/slo)
- [Time to publish](https://llmdojo.dev/glossary/time-to-publish)
- [Glossary of every term](https://llmdojo.dev/glossary)