Depends on compute capacity. If we become supply constrained on tokens, then prices will necessarily go up.
replyno they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
replyI would posit there’s no way in hell they’re getting sufficiently cheaper on a short enough time frame vs how much demand is sky rocketing. AI companies are seeing quarterly doubling of revenue if not more.
reply