Senior interview questionAsked at OpenAI · interview write-up
Build a pipeline that finds math documents in web crawls and scores their quality.
Model answer
Three stages. Recall: cheap filters for LaTeX or MathML markup, math symbols and known math domains, with extraction that keeps equations, which standard HTML-to-text drops. Precision: a fast classifier such as fastText, trained on seed math pages against random web, rerun with new seeds as DeepSeekMath did. Quality: dedupe, strip benchmark contamination by n-gram matching, and score reasoning content with a small LLM grader.
Validate by training small models on each candidate mix and comparing math benchmarks.
Practise the rest
35 Training questions, 492 in all, each with a model answer. Free.
More from OpenAI interview questions.
More Training interview questions
- Implement masked cross-entropy in NumPy that stays numerically stable, with label smoothing and a temperature.
- Explain KL divergence for language models: which direction is which, what happens when supports don't match, and how it's used as a regulariser.
- When would you use mean squared error versus cross-entropy? And what is LoRA?
- Explain Adam and its bias correction, and why AdamW decouples weight decay.
- Explain policy types in RL and modern policy-gradient methods such as TRPO, PPO and GAE, then compare linear attention and grouped-query attention.
- Predict whether an ad impression is clicked within 24 hours at a 0.7% positive rate, with high-cardinality IDs and delayed labels: how do you build and assess the model?