# Compute-bound

> Compute-bound: Work whose time is set by how much arithmetic it needs; a chip with more operations per second speeds it up.

Canonical: https://llmdojo.dev/glossary/compute-bound

Work whose time is set by how much arithmetic it needs; a chip with more operations per second speeds it up.

Learn it in the lesson: [Two kinds of slow](https://llmdojo.dev/learn/inference-optimization/where-the-time-goes/two-kinds-of-slow) (Inference and Model Optimization · Where the Time Goes: Memory, Compute and Batching).

## Interview questions about Compute-bound

- [What's the difference between compute-bound and memory bandwidth-bound work, and which one is decode?](https://llmdojo.dev/interview/q/what-s-the-difference-between-compute-bound-and-memory-bandwidth-bound-work)
- [How would you show, on a given machine, that decode is bandwidth-bound and prefill compute-bound?](https://llmdojo.dev/interview/q/how-would-you-show-on-a-given-machine-that-decode-is-bandwidth)
- [Your LLM training and serving is slow. Reason about memory-bound versus compute-bound kernels, the cost of materializing the attention matrix, HFU versus MFU, and which GPU profiling signals you'd read.](https://llmdojo.dev/interview/q/your-llm-training-and-serving-is-slow-reason-about-memory-bound-versus)
- [Estimate an FFN layer's FLOPs, parameter and activation bytes, and the communication from sharding it. Which limit binds: compute, HBM or network?](https://llmdojo.dev/interview/q/estimate-an-ffn-layer-s-flops-parameter-and-activation-bytes-and-the)
- [Walk me through how a model goes from framework code to running on a GPU.](https://llmdojo.dev/interview/q/walk-me-through-how-a-model-goes-from-framework-code-to-running)

## Related
- [Memory bandwidth-bound](https://llmdojo.dev/glossary/bandwidth-bound)
- [Arithmetic intensity](https://llmdojo.dev/glossary/arithmetic-intensity)
- [Roofline](https://llmdojo.dev/glossary/roofline)
- [Model bandwidth utilization (MBU)](https://llmdojo.dev/glossary/mbu)
- [Continuous batching](https://llmdojo.dev/glossary/continuous-batching)
- [Glossary of every term](https://llmdojo.dev/glossary)