Prefix caching

Reusing the computed KV state of repeated prompt prefixes across requests, at steep discounts. Why stable content (system prompt, examples) should come first in your prompt and volatile content last.