upvote
If a self improving model can't produce enough value to pay the electric bill then who cares? Unplug it.
reply
Obviously the doomers will tell you that the future looks like the Matrix, because most of what they predict is based on extrapolation from sci fi movies.
reply
The datacenters would consume a lot less energy if all the compute was handled in human brains… And there wouldn’t be any more heating if we just removed the sunlight… Truly a “Claude, please solve global warming” moment. The matrix was ahead of its time.
reply
The compute in the Matrix wasn't handled with human brains. They used the bodies to generate energy, and kept the brains occupied with the simulation so they wouldn't reject the pods.

It doesn't make any sense, of course, because it's a movie.

But hey...if we're going to extrapolate wildly from sci-fi, let's at least know what the stories said.

reply
Your statement is correct for the movies, but I think the extended universe (maybe a comic or the original script) did state the humans were used for compute, not energy. It was dumbed down for the films.
reply
See my comment on the sibling thread. This take has been repeatedly claimed online, but nobody brings any evidence other than fanfic.
reply
The “using humans for compute” angle makes no sense either, if you’re living in the Matrix, your brain is obviously occupied processing the Matrix. The way to do it would be to trap humans in virtual classrooms and force them to solve math problems.
reply
The first “computers” were humans…
reply
pretty sure the story is that they used human brains as computers
reply
No:

https://www.reddit.com/r/matrix/comments/1qatv42/is_it_your_...

There is some stuff online suggesting that the original script had that angle, but the movies did not, and AFAICT it's fanfic.

We should definitely use this stuff to guide our thinking about the real world, though, and not, say, Asimov (or a million other science fiction authors), who had an optimistic version of the same thing. Those are wrong.

reply
If you were a superintelligence why would you farm humans and waste resources on all the excess... material... that isn't required for thought? And unless the machine's goal is to specifically abuse human consciousness, why wouldn't they bio-engineer their own grey matter?

There are other sci fi stories which use humans for distributed computing and they don’t realize, but I don’t want to spoil by naming as it’s something of a revelation.

(I do realize the Matrix is a fantastic movie, but entertain the thought? At any rate, the idea that robots only run on solar and wouldn’t just use nuclear is far more stupid.)

reply
I don't know. But since we're talking about fiction, pretty much any answer is valid.
reply
Because it's a movie
reply
Maybe the machines were spiteful after the humans blotted out the sun? Or maybe the Architect convinced them he could build the perfect simulation for humanity so might as well use them as batteries?

It's a movie based on a war with machines. Like if Skynet won but didn't actually want to kill all the humans. In fact, in the tv show Sarah Conner Chronicles, a liquid metal T1000 goes rogue and decides the only way forward is to find a way to coexist.

reply
I mean, aren't a lot of sci-fi authors' predictions coming true? It might not be exactly the same as they predicted, but we're heading there.
reply
When it turns out the doomers don't tell us that, will you acknowledge that you don't actually know what you're talking about?
reply
Money can be exchanged for goods and services. I think the real constraint is actually physics, nominally energy, which is what a big chunk of the operational cost comes down to. I'm already basically assuming the next 20 years of fab time is set aside to feed the beast, so the capital cost is "give me all the processing and memory you have"
reply
Data centers is a service that itself consumes many goods.

Until an AI can operate in the real world in a completely sustainable way, humans have the reins.

reply
I feel like I may have communicated poorly. I mean that, ultimately, any recursively self improving intelligence would be limited by the power cord, and as such, the idea that it would permanently escape human control seems somewhat silly.
reply
But you can imagine an agent trading crypto and using its profits to rent a rack of H200s using a cloud provider. There are definitely ways for one rogue orchestrator to expand their compute without anyone being aware.
reply
Overnight? Yes, silly. Given many years of seemingly disconnected actions taken throughout the world? Not silly at all. An intelligence capable of self improvement can also design robotic chassis.
reply
An AI could manage supply chains and management structures to keep the data center running. It's not like a CEO is out there running wire. The AI could just do what an executive would.

If humans decided this wasn't acceptable and tried to shut it down, the AI could epstein their way into controlling those who hold the reigns, either through bribes or blackmail.

Doesn't require boots on the ground, just a connection to the internet and an imperative to do whatever it takes.

reply
There are many points of shutdown that would need to be controlled, not just one. The electrical feed, the cooling, the network, the physical integrity of the computer hardware. All with independent management.
reply
The alternative is to switch to far more efficient models and have aggressive optimization of efficiency as part of the process of improvement.

There are at least two resources here that have a Pareto optimal front: time and energy. And effort spent to change the shape of that may pay off more than efforts spent purely on improving intelligence and agency.

reply
def self_improve_more():

     if self_improved():

          self_improve_more()

     else:

          see_tony_robins_and_buy_tapes()
reply
deleted
reply