Although opening a new chat and asking if the previous output was correct, it detected the mistakes.
You also have to consider if an LLM can solve the Riemann hypothesis because it is 10x smarter than any mathematician, or because it is willing to write 1000x as many lines of code (including false starts) without giving up?
its because models are not trained on terrabytes/petabytes(?) of RSI generated data in your domain, unlike math and coding.
Also, there is a chance you/we can't always comprehend how smart they are.
LLMs exhibit what is known as "Jagged Intelligence" - https://news.ycombinator.com/item?id=48577159
Mathematics is one domain where they have high peaks. Why? Because we have "formalized" mathematics so well that starting with the precise and correct set of problem statements/assumptions/etc. if you follow the logical rules of inference (i.e. deductive system) then you will reach the conclusion. Formalization was invented so that we can solve problems purely mechanically at the symbolic syntax level using a machine. So the LLM proposes proof steps to the Lean proof assistant which then symbolically verifies it.
On the other hand, LLMs often fall down in "common sense reasoning" (https://en.wikipedia.org/wiki/Commonsense_reasoning) since this involves a lot of implicit context etc.
It's not like Anthropic simply gave internal Claude agents the task to solve RH and months later they came back with the solution.