Because it's typically cached for 5min (1hr is a setting you have to explicitly opt into), and very few people run loops at a cadence of < 5 mins.
replyOh! I thought Anthropic cached for one hour (by default), am I wrong about that? Or is this an OpenAI thing?
replyAnthropic changed their cache duration for some reason a while back.
reply