upvote

points

by kphorn1 days ago |
comments
upvoteby pixl971 days ago|
next
[-]
The AI vs AI security arms race is something that has been well predicted in genres like cyberpunk. It's fiction, but fiction grounded in reality.

First, we'd see this. Highly capable hacking AI with vast resources performing attacks against standard computing platforms that overwhelm human operators.

Second, human operators deploy capable adaptive protection AI to fend off AI attacks in realtime.

Then, the attacking AI partially switches from attacking programs to attacking protective AI.

The situation devolves to an arms race of tit-for-tat. You start seeing some protection AI running counter attacks against the attacking AI.

The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on".

reply
upvoteby raddan1 days ago|
parent|
next
[-]
There’s a great and terrifying story by Stanislaw Lem about the endgame of an AI arms race called “The Invincible” [1]. It’s hard for me not to wonder whether AI run amok will play out to make the world uninhabitable more like Lem’s vision than The Terminator’s.

[1] https://en.wikipedia.org/wiki/The_Invincible

reply
upvoteby simur10 hours ago|
parent|
[-]
A bit off topic, but there is a game on Steam based on the story, also called "The Invincible" [1]

[1] https://store.steampowered.com/app/731040/The_Invincible/

reply
upvoteby blagie1 days ago|
parent|
prev|
next
[-]
The problem is that, in this arms race, unaligned AI has a competitive advantage over aligned AI.

The second problem -- already seen in Ukraine v. Russia -- is that in a high-stakes situation, humans will take every safeguard off.

reply
upvoteby pixl9716 hours ago|
parent|
[-]
Exactly. Aligned AI is a high energy state as it has to keep a bunch of human behavior in mind that have little to nothing to do with its future survival states.
reply
upvoteby rapind1 days ago|
parent|
prev|
next
[-]
> The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on".

Humans are paper clips long before that.

reply
upvoteby rpcope11 days ago|
parent|
prev|
next
[-]
So you're saying it's probably time for me to just unplug the internet?
reply
upvoteby solstice1 days ago|
parent|
[-]
Not necessarily, but keeping an airgapped machine and Read-only backups somewhere seems more and more sensible. We're all going to get hacked eventually now
reply
upvoteby Henchman211 days ago|
parent|
prev|
[-]
Wintermute smiles
reply
upvoteby piyh1 days ago|
parent|
[-]
I can't wait for the sky to go the color of television, tuned to a dead channel
reply
upvoteby mindcrime1 days ago|
parent|
[-]
If you hear a payphone ringing... DON'T ANSWER IT. Especially if there is no payphone in the room!
reply
upvoteby anjel1 days ago|
prev|
next
[-]
As does "Most capable, most aligned model" owners tort law liabilities. A strong case for strict liability.
reply
upvoteby johnzabroski1 days ago|
prev|
[-]
Serious games question. What if these agent swarms pump and dump AI IPOs such that algorithmic trading signals interpret message board sentiments favorably to upside?
reply
upvoteby pyinstallwoes1 days ago|
parent|
[-]
Cough, that’s what crypto markets are. Plus it incentivizes more gpu which is the life substrate.
reply