upvote
Given they're incentivized to increase token use, what guarantees that higher token use improves the effectiveness of the agent and isn't just artificial padding?
reply
Well, nothing really. But I assume there can be some benefits to modifying context. For example, updating file contents or marking them as modified, summarization, injecting additional information, removing irrelevant tool call results, etc.
reply
Is there evidence that it is actually a better agent though?
reply
There’s evidence it’s a worse agent actually. I’m just saying in theory.
reply