Mid-level interview question
How do you decide which failure mode to fix first?
Model answer
Weigh how often it happens by how much harm it does, and both against the cost of the fix. A rare failure that gives customers wrong prices can outrank a common one that only makes them ask again. Write the severities down and agree on them, like a rubric.
Practise the rest
7 Error analysis questions, 492 in all, each with a model answer. Free.
More Error analysis interview questions
- What is error analysis?
- Your pass rate dropped five points this week. What do you do first?
- How do you make sure a fixed failure doesn't come back?
- A RAG assistant gave a wrong answer. How do you find the cause?
- What is criteria drift, and what does it mean for your evaluation?
- A recommender ranked mostly by distance raised add-to-cart rate but lowered revenue per session: diagnose why and design a replacement with experiments to separate causes.