Mid-level interview question
How do you make sure a fixed failure doesn't come back?
Model answer
Turn it into a test case: the original input, the expected answer, and a check a program can run, in a known-failures set that runs on every change. Keep that set separate from the production-like one, or a growing pile of hard cases makes an improving system look worse.
Practise the rest
7 Error analysis questions, 492 in all, each with a model answer. Free.
More Error analysis interview questions
- What is error analysis?
- Your pass rate dropped five points this week. What do you do first?
- How do you decide which failure mode to fix first?
- A RAG assistant gave a wrong answer. How do you find the cause?
- What is criteria drift, and what does it mean for your evaluation?
- A recommender ranked mostly by distance raised add-to-cart rate but lowered revenue per session: diagnose why and design a replacement with experiments to separate causes.