Mid-level interview question
Your pass rate dropped five points this week. What do you do first?
Model answer
Read a sample of the new failures and note what went wrong in each, in plain words, before trying a fix. Then group the notes and count them. Read some passing outputs too: scorers and judges can pass things for the wrong reason.
Practise the rest
7 Error analysis questions, 492 in all, each with a model answer. Free.
More Error analysis interview questions
- What is error analysis?
- How do you decide which failure mode to fix first?
- How do you make sure a fixed failure doesn't come back?
- A RAG assistant gave a wrong answer. How do you find the cause?
- What is criteria drift, and what does it mean for your evaluation?
- A recommender ranked mostly by distance raised add-to-cart rate but lowered revenue per session: diagnose why and design a replacement with experiments to separate causes.