Junior interview questionAsked by candidates · YouTube
Prompting, RAG or fine-tuning: how do you choose?
Model answer
Start with prompting: cheapest, and often enough. Add RAG when the model lacks knowledge, especially private or changing facts. Fine-tune when it has the knowledge but not the behaviour, like a format, tone or narrow skill that prompt examples can't fix. They combine, and fine-tuning is the costliest to change.
Practise the rest
20 Fine-tuning & alignment questions, 492 in all, each with a model answer. Free.
More Fine-tuning & alignment interview questions
- What is LoRA, and why is it so much cheaper than full fine-tuning?
- You're handed fine-tuning code whose loss behaves oddly. What do you check?
- Compare RLHF with a reward model to DPO.
- Debug a GRPO training loop. What is the probability ratio, and what goes wrong with it?
- Design a platform for fine-tuning LLMs on AWS, covering distributed training and security between tenants.
- How do you detect and prevent reward hacking during LLM post-training?