Mid-level interview questionAsked at Capital One · interview write-up
The prompt mixes a regression target with precision and recall: untangle it, and pick metrics and a modeling plan tied to the real decision.
Model answer
Ask what decision the output drives. Approve or decline is binary, so use precision and recall at the operating threshold, set by error costs. How much, like a loss amount, is regression, judged by MAE or RMSE.
Often it's both: predict the probability of default and the loss if it happens, and combine them into expected value per decision. Agree the metric with stakeholders before modelling, and validate on a time-based split.
Practise the rest
10 Success criteria questions, 492 in all, each with a model answer. Free.
More from Capital One interview questions.
More Success criteria interview questions
- What is evaluation-driven development?
- What kinds of criteria would you use to evaluate an LLM application?
- Two annotators grading the same chatbot replies keep disagreeing. What do you change?
- Your support bot's factual consistency is 90%. Is that good enough to automate support?
- Version B has a higher pass rate than version A on last week's production logs. Do you ship B?
- How would you design the evaluation for a two-step résumé parser: PDF to text, then text to current employer?