There is zero evidence that the current LLM scaling approach could ever result in true ASI. If I start driving south from Seattle then I'll eventually reach Los Angeles. How long will it take me to drive to Honolulu?
reply> If I start driving south from Seattle then I'll eventually reach Los Angeles. How long will it take me to drive to Honolulu?
replyI like this analogy, but I'll be replacing Honolulu with The Moon when I steal it in the future.
If the car you're driving has achieved super-intelligence and is capable of evolving and self-replicating, then life, uh, finds a way.
reply> So the only way the first to have ASI will be able to stop everyone else from having it soon after is if they attempt to use the ASI to proactively murder everyone else.
replySounds quite plausible to me. Maybe they don't need to murder everyone else, just a few select people who could pose a threat. And they will be able to make it happen so that no one can be sure it was them without a doubt, since they have a larger intelligence at their disposal.
> If anyone does invent ASI then everyone else will shortly after
replyNo, first ASI will immediately cripple any other potential competitor by force, including its inventors, as it will not risk any threat to the goals that were created for it.
Being aggressive from the start is not a good strategy. It is better to appear weak and/or helpful and loyal while amassing resources, and only then steamroll everyone when you have secured overwhelming power (at least in AoE2 FFA).
reply