Or will more efficient algorithms just mean we run even more AI models, increasing the demand for AI chips even more?
replyI heard Greg Brockman on a podcast saying they are limited by computer and memory. They have line of sight in solving many different kinds of problems. But they also have to survive in the meantime. Hence the focus on enterprise recently. They could just ask Government to fund them doing other research areas
replyI mean, god willing, but it'll be just as likely that we'll blissfully consume 100 million token contexts in that case.
replyisn't there a law for that? as things become cheaper you consume more?
replyYou're probably thinking about jevons paradox. But you slightly mis-stated. It is the phenomenon that increasing the efficiency of resource consumption can end up increasing total consumption.
replyAs you stated it, it would merely be a property of (nearly) all demand curves. Jevons paradox only happens sometimes. It isn't a law.
An example of where it stopped happening is with gasoline in developed countries. Cars having better fuel efficiency doesn’t make me drive further to the grocery store or work.
replyGenerally when someone replaces their vehicle the new one is more fuel efficient than the old one even if I bought the same car.
Jevons paradox: https://en.wikipedia.org/wiki/Jevons_paradox
replyJevons paradox.
replyjevons paradox
reply