Semantic caching
Also called semantic cache
Returning a stored answer when a new query's embedding is similar enough to a stored query's, above a threshold. Raises the hit rate, but can return the answer to a different question.
Also called semantic cache
Returning a stored answer when a new query's embedding is similar enough to a stored query's, above a threshold. Raises the hit rate, but can return the answer to a different question.