On the one hand, compacting at 300k saves OpenAI 40%. That's great.
replyOn the other hand, $10 for 1M tokens still seems really high? It's not too hard to blow through that in an hour or two.
On the other hand, $10 for 1M tokens still seems really high? It's not too hard to blow through that in an hour or two.