Agent retries
Coding agents retry the same job and rephrase until the answer looks done. Final text for that job can hit. Tool-call steps still run.
receipt · same job → final text HIT · tool_calls not stored
Use cases
Four loops where requests repeat, and a list of where MorrowCache doesn’t help.
Trace
Please explain mutexes simply
Coding agents retry the same job and rephrase until the answer looks done. Final text for that job can hit. Tool-call steps still run.
receipt · same job → final text HIT · tool_calls not stored
Users ask the same FAQ with different words. Exact caches miss. Intent admit reuses the good answer.
receipt · FAQ cluster · one completion · many wordings
Run adjudication locally when you don’t want every decision to leave the machine.
receipt · local judge · cloud or local completions
When the question depends on time, refuse the stale hit and call the model.
receipt · "what's the latest" · refuse → miss
Who this is for
Solo builders, agent-assisted engineers, cost-conscious apps on OpenAI-compatible APIs.
Where we don’t win
Replaying tool calls, personalized secrets, live answers that must stay fresh, sites you don’t control.