Mid-level interview questionAsked at Uber · interview write-up
A recommender ranked mostly by distance raised add-to-cart rate but lowered revenue per session: diagnose why and design a replacement with experiments to separate causes.
Model answer
Sorting by distance favours cheap, nearby items, so carts fill more often but with smaller baskets. Decompose revenue per session into conversion times order value and slice by category and price band to see which term moved.
Replace it with a ranker scoring expected revenue: relevance times conversion times basket value, with distance as one feature. To separate causes, A/B test old, new, and a distance ranking reweighted to the old price mix.
Practise the rest
7 Error analysis questions, 492 in all, each with a model answer. Free.
More from Uber interview questions.
More Error analysis interview questions
- What is error analysis?
- Your pass rate dropped five points this week. What do you do first?
- How do you decide which failure mode to fix first?
- How do you make sure a fixed failure doesn't come back?
- A RAG assistant gave a wrong answer. How do you find the cause?
- What is criteria drift, and what does it mean for your evaluation?