Given how heavily subsidized it is at the moment, the efficiency isn’t as important. Typically efficiency would give you more at lower cost, but with token prices so removed from actual cost that plays less of a role here.
replyIf the inference gets an order of magnitude cheaper, labs can afford to subsidise an order of magnitude more usage for the same marketing cost. So that part of usage will, if not accelerate with efficiency, at least still grow linearly with it. And there is a substantial amount of usage at or above true costs - everyone using a 3P harness, everyone on enterprise contracts, and everyone self-hosting an open weights model in a 3P cloud.
replyThey improved the efficiency of coal?
replyAbsolutely. Early engines were so inefficient that they could basically only be used in coal mines.
replyMassively. Extracting more useful energy from coal has always been a goal.
replyVery much unlike with software. Where the goal for long while is to burn as many resources as possible on end user devices.
I assume the reference was to the Jevons paradox, as described in Jevons' 1865 book, "The Coal Question". Watt's steam engine massively increased the efficiency of coal in steam engines, which increased the use of coal fired steam engines, which increased coal consumption.
replyOf coal use, yes. That's what inspired this: https://en.wikipedia.org/wiki/Jevons_paradox
replyThe (any!) comparrison to photovoltaics is
not acurate.Photovoltaics (PV) are primary energy producing infrastructure that produces its own fuel and is now verticly integrated into it's own supply chain, nothing other than life itself posseses this atribute.
AI, is exceptionaly likely to work in exactly the opposite fashion and take its host out as it goes down.
replyWhen PVs got cheaper, more of them were sold.
replyPV had to prove that it was truely indispensable and also prove to have realistic prospects for improvement and volume production before investments were made, and then prices came down.
AI has proven that it burns more money faster than anything else, ever.
I will admit that I am an early adopter of solar, but an AI refusenic, but still there is no reasonable comparison of AI and
anything outside of religion.
reply[flagged]
reply