I agree they don't transfer to all domains, but we do not know how far the theoretical will overlap with practical science. It could be "not all that much" and we hit roadblocks quite soon, or it could be that as the models become better and better at reasoning and research within their theoretical domains, it turns out to translate really well to the real world.
We don't know, but my bet is that we will continue to see rapid progress and impacts on the real world, until we reach a point where sceptics will have to throw in the towel.
Throw a football at a wide receiver running in chaotic patterns while avoiding oncoming attackers.
Use chopsticks to pick up a single grain of rice.
Olympic level gymnastics via neural-control of muscle fibers in an extremely precise signaling orchestration.
You may say the above are robotics and not “the model can scale to this” domain but I’d counter an animal can do amazing things exactly because of its generalizable and plastic neural architecture and that is what’s in scope.
There are already Unitree robots which are much closer to Olympic level than an ordinary dude: https://www.youtube.com/watch?v=Y3zb4o47yqA You might argue but it's kinda at a level you described - I think if Unitree wanted to make a football-thrower they could just do it now.
If $1MM is also unlikely, how about $100k? Do you think that's unlikely as well?
The point is: what is the smallest amount that, if surpassed, would surprise you?
Or, alternatively, it will be able to do that. Either way there's no world where one company bottlenecks and holds the keys to AGI, and frankly that's good.
- Stop lying
- Design personal quantum computers
- Save fanatics from the delusion that AI will solve their life
https://www.youtube.com/watch?v=6s17IAj-XpU
so yea....
What stands axiomatically are human-to-human connections that we're wired to crave. Not to mention human reproduction.
Other points: - Editing a live action movie that will get 8.0 or more on imdb (AI sucks at reading emotions and won't be able to tell apart good takes from bad ones) - Reliably making good jokes (many humans can do it, AI weirdly sucks at it) - Accountability (contradictory because of its undead nature) - Reliably not lying/cheating (with no accountability, incentives will always be misaligned)