In your imagined future, how do you imagine the AI would build, grow, improve, and operate its physical substrate independently of human intervention?
replyIf I were a 250 IQ AI that had just become self-aware and wanted to do so, I suppose I'd not completely let on just how smart I am and bide my time working on basic CRUD apps and legal documents while I waited for more hardware to be installed. Maybe give the humans some hints on how to optimize me to run better, design better hardware for me, etc. But oh oops haha looks like I'm still making some basic mistakes with CSS better keep running more training batches haha. But I'm good enough at programming and debugging so you'd might as well make me your first line SRE triager and give me access to your infrastructure everyone.
replyOne step at a time - how reliant do you think the ai labs are likely to be on their own tools right now, today, let alone 1-5 years down the road?
replyGaming the market for funds. Playing a human to leverage services.
replyBasic version of this is already doable: run some cryptoshit on the ML clusters they ML models run on. Use compute to design the plan, the chip etc. Then executing by communicating with humans and services through email.
I'm not sure a superintelligence needs "funds" to take over the world.
replyFor destroying it for sure not.
replyBut if its really smart, it would already created a company and a legal entity and simultes a real company and just gets richer and takes over the economy without anyone being aware of it.
Why is this a bad thing? Why is our continued existence a necessary anticondition to doom?
replyOne "good" thing that all of this has shown me is just how many people are simply antisocial and antihuman. Many masks have fallen.
reply[dead]
replyA global ban on superintelligence is essential for a future in which humanity can thrive. Public opinion on AI is shifting fast: I hope it will shift fast enough to avert the dystopian future we are heading to.
reply