Junior interview question
What are context precision and context recall?
Model answer
Precision: of the documents retrieved, the share that's relevant. Recall: of the relevant documents, the share retrieved.
Recall is harder in production: it needs every document judged for each query, so some frameworks report precision only.
Practise the rest
6 RAG evaluation questions, 492 in all, each with a model answer. Free.
More RAG evaluation interview questions
- Two systems each retrieve one relevant result in their top three, at positions 1 and 3. How do rank-aware metrics tell them apart?
- Why score retrieval and answers separately?
- What's the difference between faithfulness and citation precision?
- Your RAG answers score faithfulness 1.0, yet users report wrong answers. How?
- How do you make a RAG system say “I don't know”, and how do you know it's working?