Mid-level interview question
Your feature costs too much. Which levers do you compare?
Model answer
Prompt caching of a shared prefix, routing easy requests to a smaller model, shorter outputs, and fewer input tokens. In the course's illustrative model, caching or routing roughly halves a $27,000 month; both together reach about $8,000.
Each has a quality side: measure it before shipping.
Practise the rest
6 Budgets questions, 492 in all, each with a model answer. Free.