Mid-level interview question
Why pin model versions when using an API?
Model answer
The model behind an API name can change, sometimes without notice. The book cites Voiceflow reporting a 10% drop between GPT-3.5-turbo versions.
Pin a dated version where offered, and treat any switch as a release: rerun the evaluation and regression suites.
Practise the rest
6 Model routing questions, 492 in all, each with a model answer. Free.