Take mathematics as an example. Humanity has found math notation, which allowed to express math rules — distill them to the core. Before math was expressed in prose — a very inefficient way, very similar to current LLMs.

In my school, math teacher was giving me prose, which I was converting to math notation. I could argue, that this prose→reasoning conversion is not required at training, and can be obtained at inference time with search tools.