Junior interview questionAsked at Oracle · interview write-up
For a medical conversational AI, how would you source and split data, choose between prompting, fine-tuning and RAG, and evaluate for hallucination and unsafe advice?
Model answer
Use vetted clinical guidelines and de-identified, consented conversations, split by patient so nothing leaks into the test set. Start with RAG over trusted guidelines for current, cited facts; fine-tune only for tone or format. Clinicians check each claim against sources, and a test set of unsafe-advice cases, like emergencies, must trigger referral.
Practise the rest
11 Hallucination questions, 492 in all, each with a model answer. Free.
More from Oracle interview questions.
More Hallucination interview questions
- What is a hallucination, and why can a next-token predictor produce one so fluently?
- GPT-2 small completes 'The capital of Australia is the city of' with Sydney. Walk me through why a model does that.
- Why do long generated answers leave more room for hallucination than one-word answers?
- You want to automatically flag answers that are probably wrong, using the model's token probabilities. How would you design and validate that?
- You're shipping a support bot that answers from your company's policy documents. What do you put in place to reduce hallucination, and how do you evaluate it?
- Design how a chatbot falls back when it doesn't know the answer, covering uncertainty, retrieval and tools.