Model caches

Caching LLM calls can be useful for testing, cost savings, and speed.

Below are some integrations that allow you to cache results of individual LLM calls using different caches with different strategies.

Name	Description
Azure Cosmos DB NoSQL Semantic Cache	The Semantic Cache feature is supported with Azure Cosmos DB for NoSQ...