With writing it's just more obvious. LLMs don't write with personality. They don't create new and exciting worlds on their own. Everything they output feels derivative.
In mathematics you see the same effect. They are very good at finding results that humans missed, taking advantage of their broad knowledge and tireless work ethic.
But just as they have been unable to create new literary worlds, they also have so far been unable to create new mathematics.
I believe this lack of creativity is intrinsic to how these models are architected and trained. We want models that produce these in-distribution outputs because those types of models are more economically valuable. Nobody wants a coding agent with spontaneity, we want models that predictably and obediently solve problems - and that's what we got.
There's no way you can conclude that. Yes, "Fable 2" or whatever this was probably won't. But we can't know what Fable 3/4/5/etc will be able to do.
If anything, if we have 1 or 2 more years of progress like the last 12 months, which have been insane, I'd say LLMs are likely to solve it.