Senior interview questionAsked at PayPal · interview write-up
When would you use unsupervised methods for fraud detection, and how would you evaluate them without reliable labels?
Model answer
Use them when labels are scarce, delayed or blind to new attacks: isolation forests, autoencoder reconstruction error or graph clustering flag what's unusual, not what's known fraud.
Evaluate by proxy. Backtest on the labels you do have with precision at the top k, since investigators can review only so many. Send flagged and random cases to analysts to estimate precision and lift. Inject synthetic anomalies to check recall, and track alert volume and stability over time. Unusual isn't fraud, so feed confirmed cases into a supervised model.
Practise the rest
10 Success criteria questions, 492 in all, each with a model answer. Free.
More from PayPal interview questions.
More Success criteria interview questions
- What is evaluation-driven development?
- What kinds of criteria would you use to evaluate an LLM application?
- Two annotators grading the same chatbot replies keep disagreeing. What do you change?
- Your support bot's factual consistency is 90%. Is that good enough to automate support?
- Version B has a higher pass rate than version A on last week's production logs. Do you ship B?
- How would you design the evaluation for a two-step résumé parser: PDF to text, then text to current employer?