LLMs are able to ingest numbers. And not just Arabic numerals; Did you know that there are other kinds of number systems?
Believe it or not, they also ingest multimedia. You don't need the English language to talk to a language model. Anything can be a language; you can communicate using only images.
And for that matter, modern LLMs are great at abstract math (and like anything else the results still need proofreading).