upvote
The demand for them is growing _per person_, not just across the wider economy, if tokens cost half as much but you want to use 3 times as much you're going to have to pay more.
reply
Maybe 1000s of tokens per second unlocks realtime robotic decision making, and now every robot needs to continuously stream tokens to and from the cloud to operate. That could 1000x demand overnight, just to speculate :)
reply
I would very much like it if anything that moves with appreciable mass is governed locally just in case the link drops and/or latency suddenly goes up. Motion is very unforgiving and accidents will happen if that's not taken into account.
reply
I think you just found what we will see in the S-1 prospectus of OpenAI
reply
Seems unsafe to make locomotive decisions remotely
reply
Think about the agents buying computers for their agents. /s
reply
The price has been going down for ages, its not clear what you are pointing at
reply
Pointing at the nay sayers who say tokens are heavily subsidized and it’s all going to come crashing down soon, surely any moment now
reply
I mean, it will obviously crash at some point. With so much pressure on token price to go down that means way less opportunity for margin for AI providers. OpenAI is in a pretty bad situation
reply
What does this have to do with margins? It can remain the same once prices go down
reply
At the price going down? And that it will continue to go down, even if the hardware improvements stop. Not sure what isn’t clear
reply