Senior interview questionAsked at Airbnb · interview write-up
Design a RAG system that reads company policies and writes step-by-step, cited instructions for a human support agent. How do you check a policy applies, and debug a wrong instruction?
Model answer
Index policies as versioned documents with metadata: region, product, user type, effective dates. Extract the case facts from the ticket first, retrieve policies whose metadata matches, then run an applicability check: does each candidate cover this region, date and booking type? The model writes numbered steps, each citing a policy clause, or says none applies.
Log policy versions, retrieved chunks and prompt version with every answer. When an agent reports a wrong instruction, replay it against that exact policy set to see whether retrieval, applicability or generation failed.
Practise the rest
22 RAG questions, 492 in all, each with a model answer. Free.
More from Airbnb interview questions.
More RAG interview questions
- What is retrieval-augmented generation, and how does it reduce hallucination?
- How do you choose a chunking strategy for RAG?
- Why combine keyword and embedding search, and where does a reranker fit?
- How do you evaluate a RAG pipeline?
- Your RAG chatbot keeps giving wrong answers. How do you find out why, and fix it?
- Design a RAG system that has to meet strict latency and cost targets while serving many tenants.