Prompt Caching for AI Agents: Reduce LLM API Costs
sayanteka chakraborty · 4:49
Prompt caching reduces LLM API cost by processing a large static prefix (system prompt, policies, tool definitions) once and reusing it at a discounted rate, while the small changing part—usually the user question or...