Junior interview question
What's the difference between exact and subjective evaluation?
Model answer
Exact evaluation gives the same verdict every time: code passes its tests or it doesn't; an answer matches or it doesn't. Subjective evaluation depends on the judge, a person or a model, and can change between graders or runs. Prefer exact where the task allows, so a moving score means the system moved.
Practise the rest
8 Reference scoring questions, 492 in all, each with a model answer. Free.
More Reference scoring interview questions
- What is pass@k?
- Why can BLEU or ROUGE mislead you when evaluating a model?
- When would you use semantic similarity instead of word overlap, and what does it depend on?
- How do you choose a scoring method for a new LLM feature?
- Can perplexity tell you which of two chat models is better?
- Implement AUC-ROC with correct tie handling, a numerically stable softmax, and logistic regression trained with cross-entropy and L2 regularization.