Roofline
Also called roofline chart
A chart of achievable operations per second against arithmetic intensity: a sloped roof set by memory bandwidth and a flat roof set by peak compute, meeting at the ridge.
Interview questions about Roofline
- How would you show, on a given machine, that decode is bandwidth-bound and prefill compute-bound?
Measure both ceilings, a large memory copy and a large matrix multiply, and place each phase on a roofline.