upvote
Centralization is vastly more energy efficient than decentralization, by orders of magnitude. LLMS love batching, to an insane degree. Running a single conversation through a GPU is about the same cost as doing ~100 in parallel.

Centralization is a huge huge environmental win, far far more than even cloud computing was compared to tons of inefficient, under utilized racks spread though our office buildings.

reply
Huge environmental win if considering a fixed supply & demand, but Jevons Paradox kicks in with tokens in the cloud
reply
Decentralization can also cause havoc because of back-EMF for instance, in any case the public infrastructure needs time to adapt to demand.
reply