Explainers: Prompt caching
Prompt Caching vs Semantic Caching vs RAG
Prompt caching, semantic caching and RAG reuse different things. Pick the right layer for cost, safety and freshness.
Prompt caching costs: reads, writes and real savings
A worked example of API cache reads, writes and the cost of changing input and generated answers.