Mid-level interview question

RAG or fine-tuning?

Q: RAG or fine-tuning?

Classify the failures. Information failures (missing or outdated facts) call for RAG; behaviour failures (wrong format, style or relevance) for fine-tuning. The book: fine-tuning is for form, RAG is for facts. With both, start with RAG.

Model answer

Classify the failures. Information failures (missing or outdated facts) call for RAG; behaviour failures (wrong format, style or relevance) for fine-tuning. The book: fine-tuning is for form, RAG is for facts. With both, start with RAG.

Practise the rest

6 When to fine-tune questions, 492 in all, each with a model answer. Free.

Read the lesson Practise When to fine-tune

When should you fine-tune instead of prompting?
Give good reasons to fine-tune.
Why does full fine-tuning need so much memory, and what does LoRA change?
Make the case against fine-tuning for a team that wants to.
How would you assess whether an AI feature is ready for production?

Model answer

More When to fine-tune interview questions

Model answer

More When to fine-tune interview questions