Claude Code's prompt cache expires after 1 hour.
replyThe cache shouldn't affect inference. It is purely an I/O optimization.
replyI think it should, as you dont need to use the encoder layer on the new tokens, you just read the embedding from the cache. that's why cache reads are cheaper
replyIs that from start of a new conversation per conversation?
replyIt's supposed to be for token optimization (https://code.claude.com/docs/en/prompt-caching), but are people experiencing degraded performance when you let Claude Code sit for hours/days and come back?
replyyes, 100%.
reply