- Not everyone uses dollars.
- The price of credits in some currency could change after you bought them.
- The price of credits could be different for different customers (commercial, educational, partners, etc)
- They can ban trading of credits or let them expire
And now it feels like the are gamifying the compute we use for work for all the same reasons.
If you have some left over that you can’t spend, it feels like you’ve “wasted” them.
Even for a single standalone LLM that's the case, and the 'agentic' layers thrown on top just make that problem exponentially worse.
One'd need to entirely switch away from LLMs to fix this problem.
The answer is so that they can charge different prices per credit. If you buy low amounts, they can charge one price. If you buy in bulk, they can offer a discount. The usage is the same, but they can differentiate price per usage to give people more a favorable price if they are better customers.
Is there anything wrong with that?