# Token ID

> Token ID: The integer a tokenizer assigns to a token: its position in the vocabulary. IDs only mean something within the vocabulary that produced them.

Canonical: https://llmdojo.dev/glossary/token-id

Also called token IDs.

The integer a tokenizer assigns to a token: its position in the vocabulary. IDs only mean something within the vocabulary that produced them.

Learn it in the lesson: [Models do not read text](https://llmdojo.dev/learn/model-foundations/tokenization/models-do-not-read-text) (Model Foundations · Tokenization: From Text to Token IDs).

## Interview questions about Token ID

- [You're moving a product from a model that uses cl100k_base to one that uses o200k_base. Nothing crashes in staging. What could still be broken, and what goes into the migration plan?](https://llmdojo.dev/interview/q/you-re-moving-a-product-from-a-model-that-uses-cl100k-base)
- [After a library upgrade, your self-hosted Llama 3 gives worse answers and no errors. How do you debug it?](https://llmdojo.dev/interview/q/after-a-library-upgrade-your-self-hosted-llama-3-gives-worse-answers)
- [Turn an LLM into a binary classifier using its log-probs and log-sum-exp.](https://llmdojo.dev/interview/q/turn-an-llm-into-a-binary-classifier-using-its-log-probs-and)

## Related
- [Token](https://llmdojo.dev/glossary/token)
- [Tokenizer](https://llmdojo.dev/glossary/tokenizer)
- [Vocabulary](https://llmdojo.dev/glossary/vocabulary)
- [Byte pair encoding (BPE)](https://llmdojo.dev/glossary/bpe)
- [Subword](https://llmdojo.dev/glossary/subword)
- [Special token](https://llmdojo.dev/glossary/special-token)
- [Glossary of every term](https://llmdojo.dev/glossary)