Prompt Caching

DraftAI Engineeringllmcost Created Oct 1, 2026

Idea

Keep the stable part of a prompt at the start, so the provider can reuse it between calls.

Notes

Work in progress. Related: Rate Limiter.