deployment
Prompt Caching
An optimization technique that stores and reuses computed key-value pairs from previously processed prompt prefixes. Prompt caching avoids redundant computation when the same system prompt or context is used across multiple requests.
In practice
Anthropic's prompt caching reduces costs by up to 90% when the same long system prompt is reused across thousands of API calls.