"making a new theory that is really useful is out of reach for the moment in my opinion."
replyCurious how this ages.
Recursive self improvement, self-play and multi-agent RL could make useful new theories, eventually.
Sure, and I hope LLMs will at some point be able to do it. It would simplify greatly my work.
replyHowever, at the moment I consider that they stay in the 'convex hull' of their training set + a provided context, and I don't see that much research that made real improvements to the situation.