Logprob
Also called logprobs
The natural log of a token's probability. Useful for debugging, but not a measure of whether an answer is true.
Interview questions about Logprob
- A PM wants to show users a 'confidence' percentage computed from the answer's token probabilities. What's your position, and what would you build instead?
Against it: a token probability says how typical the text is after the prompt, not whether it's correct.