upvote
Setting a cap motivates developers to invest their tokens wisely such as choosing the right models and not burning tokens for fun or side projects, same as any budget.. it’s not any deeper than that.

At my company we can ask for temporary cap limits if it’s justified, which is fairly common.

reply
"I suspect this is a first pass at figuring how to budget them and there will be a second pass."

Completely agree with that.

reply