Mid-level interview questionAsked at Harvey · interview write-up
Design an agent that classifies uploaded documents and suggests traceable revisions, keeping deterministic rules separate from model judgment and letting a human override.
Model answer
Split the work by what can be checked. A classifier labels the document type, and the type selects a rule set. Checkable rules run as code: required clauses present, dates valid, amounts consistent. The model handles judgment rules, and every finding cites the rule id, the exact span and a proposed edit. Suggestions arrive as a reviewable diff; humans accept, reject or override, and their decisions are logged as eval data.
Practise the rest
15 Agents questions, 492 in all, each with a model answer. Free.
More from Harvey interview questions.
More Agents interview questions
- What actually is an AI agent?
- LLM workflow or agent: which is better?
- Your agent is very slow. What can you do?
- What are guardrails, and where do they sit in an agent?
- What are the bottlenecks of AI agents, and how do you keep them in check?
- Design a harness for running a tool-using agent safely, and an evaluation platform on top of it.