Maxim Khailo's Writing
  • Home
  • About
Sign in Subscribe

llm

A collection of 2 posts
Your Agentic Workflow's Cache Keepalive Costs 8x Too Much (v2: the interval frontier)
llm

Your Agentic Workflow's Cache Keepalive Costs 8x Too Much (v2: the interval frontier)

Updated with the full retention curve and the interval frontier: the keepalive saves on Anthropic AND OpenAI inside each provider's paying band, OpenAI's optimal interval is 8 minutes not 4, and an interval past the TTL is actively toxic: every ping re-prefills a dead cache at full price.
24 Jul 2026 10 min read
Your Agentic Workflow's Cache Keepalive Costs 8x Too Much
llm

Your Agentic Workflow's Cache Keepalive Costs 8x Too Much

Everyone pings their prompt cache every 30 seconds. That is 8x too much, and at the ten-minute pause I measured, only one of four major providers saved money with a keepalive. Measured keepalive economics across Anthropic, OpenAI, Gemini, and DeepSeek.
21 Jul 2026 8 min read
Page 1 of 1
Maxim Khailo's Writing © 2026
  • Sign up
Powered by Ghost