Yes, but, I can run qwen 3.8 flash next (> 100b parameters; ~ opus 4.6) on a 200W tdp desktop.
replySo, assume 8 of those, and it’s a space heater per house. I have never been disturbed by my neighbor’s space heater.
The problem is centralization, not the absolute energy usage. (And also that LLMs are trending to 100x more efficient than the data center sizing assumed).
Centralization is vastly more energy efficient than decentralization, by orders of magnitude. LLMS love batching, to an insane degree. Running a single conversation through a GPU is about the same cost as doing ~100 in parallel.
replyCentralization is a huge huge environmental win, far far more than even cloud computing was compared to tons of inefficient, under utilized racks spread though our office buildings.
Decentralization can also cause havoc because of back-EMF for instance, in any case the public infrastructure needs time to adapt to demand.
replyWhat is your point?
replyCalculate the scale. Add it up. Do it.
Look at the numbers and come back to me.
He is a Marxist (the alienation rhetoric gives it away) he is primarily interested in causing social revolution not in environmentalism or anything else.
reply