> with previous RL-systems

Most human systems are much, much, much more complicated than most closed world games (which is where RL approaches have seen massive success, mostly through self-play).

Like LLMs are great, but I honestly can't see us getting actual general intelligence out of them.

<< One popular idea is that these systems will asymptotically approximate human intelligence because they're trained on mostly human-written texts.

Can you elaborate on this? I am clearly not aware of this line of thinking and the related contradiction.