Mid-level interview questionAsked by candidates · YouTube
How do you choose a chunking strategy for RAG?
Model answer
Chunks should be small enough to be specific and big enough to stand alone. Split on the document's own structure first, like headings and paragraphs, then cap the size in tokens with a little overlap so no sentence loses its context. Prefix each chunk with its title or section path. Then pick the size by measuring retrieval on real questions, not by rule of thumb.
Practise the rest
22 RAG questions, 492 in all, each with a model answer. Free.
More RAG interview questions
- What is retrieval-augmented generation, and how does it reduce hallucination?
- Why combine keyword and embedding search, and where does a reranker fit?
- How do you evaluate a RAG pipeline?
- Your RAG chatbot keeps giving wrong answers. How do you find out why, and fix it?
- Design a RAG system that has to meet strict latency and cost targets while serving many tenants.
- Design an agent for searching internal documents that respects permissions, cites sources and abstains when it should.