Junior interview question
What is evaluation-driven development?
Model answer
Writing down how you'll evaluate an application before you build it, the way test-driven development writes tests before code. You decide the criteria, and how each is scored, first. Otherwise you ship something that costs money to run and that nobody can say is working.
Practise the rest
10 Success criteria questions, 492 in all, each with a model answer. Free.
More Success criteria interview questions
- What kinds of criteria would you use to evaluate an LLM application?
- Two annotators grading the same chatbot replies keep disagreeing. What do you change?
- Your support bot's factual consistency is 90%. Is that good enough to automate support?
- Version B has a higher pass rate than version A on last week's production logs. Do you ship B?
- How would you design the evaluation for a two-step résumé parser: PDF to text, then text to current employer?
- The prompt mixes a regression target with precision and recall: untangle it, and pick metrics and a modeling plan tied to the real decision.