Hacker News
new
past
comments
ask
show
jobs
points
by
mrtesthah
12 hours ago
|
comments
by
hedgehog
10 hours ago
|
[-]
I auto compact around 200k tokens both due to this and because the cached read cost really escalates when sessions have more tokens than that (too short and you pay a lot in per-compact re-reading of state)
reply