Ergo all defined axiomatic systems have sentences about the far past and future that cannot be defined in those languages with certainty. Most do not make the connection to physics. Gödel did and would 100% aware the limits exist and will always exist
Scaling laws aren't just for computers; humans cultures do not scale infinitely through time, just approximately 2-3 generations
As I understand immutable physical truth like this played a huge role in his early research and ultimately were the forcing function that led him to incompleteness
This is often misunderstood or misstated to mean that there are some things that are unknowable or unable to be solved. (I'm not saying that's what you were implying, I am referring to the common way I see his theorem being represented)
But what he really proved is that no single sufficiently powerful, consistent, effectively specified formal system can prove every arithmetic truth.
He didn't prove that there are mathematical truths that are unsolvable through any possible extension or alternative framework. It's just that one framework isn't enough to solve all problems.
Scaling issues do not just matter when making bridges and when hosting LLMs.
Back in Gödel's day physicists were like rockstars and all Gödel's output was 100% influenced by Einstein and the rest. Given the group's expertise in the domain the implicitly forever incomplete/never computed did not need to be spelled out explicitly.