These are absolutely worth studying, but being what they are, nobody should be dumping massive amounts of money on them. I would not find it persuasive if researchers used LLMs to solve the Collatz conjecture or finally decode Etruscan. These are extremely valuable, but it is unlikely to be worth it for an LLM just grinding tokens like crazy to do it.

This is after the fact justification. You are arguing that because a thing (number theory) showed practical applications we should have dumped a lot more effort into it. There is no basis for this argument whatsoever; it also seems to involve inventing a time machine. Number theory had no practical applications until the development of public-key cryptography, but you cannot make funding decisions based on the future since it’s unknowable.

Once we get something working, sure, you can justify more aggressive investment. This is not to say that we should not invest in pie-in-the-sky ideas. We absolutely should and need to. Moonshot research or even somewhat esoteric research is vital, but the current investment in AI is so far out of the ballpark of rational. There’s an energy of a fait accompli here, except it’s still very plausible this is all unsustainable and the market implodes instead.