DeepThinking AI

Tag

prompt-caching

Covered in Agents & ProtocolsAI Engineering, where the background and the sources for this subject live.

Agents & Protocols

How do cacheable MCP tool lists change your token bill?

MCP revision 2026-07-28 requires ttlMs and cacheScope on every list result and tells servers to return tools in a deterministic order. Both are filed as minor changes. They are the most direct cost change in the revision, because tool definitions sit in the cacheable prefix of every agent step.

3 min read

AI Engineering

When does prompt caching actually save money?

Prompt caching stores a prefix of your prompt so later requests reuse it instead of reprocessing it. Reads are far cheaper than base input tokens, but writing the cache costs a premium and entries expire. It pays whenever a large stable prefix is reused several times inside the TTL, and loses on one-shot traffic.

5 min read