Cost per useful answer
Also called cost per useful output
Total spend divided by answers that were both on time (met the SLO) and correct. Retries, late replies and wrong answers all raise it.
Interview questions about Cost per useful answer
- (Illustrative numbers.) Model A costs $0.004 per request and is correct 50% of the time; model B costs $0.006 and is correct 95% of the time. Which is cheaper, and what should you track?
B. Track cost per useful answer: spend divided by answers that were on time and correct.