How could a theoretical mathematician not be massively disconnected from the reality of life for the ordinary person? We usually celebrate their quirks until they come into conflict like this.
When thinking about math, Tao is in another world unfamiliar to us. But, he grew up in our world and is a professor in our world and if you listen to him, seems like a pretty normal guy. I think he just made a bad analogy here.
If true, this would be observed at least partially in software engineers as well, since what we deal with is kind of made up as well, but I don't see it.