On the opposite end: I had a coworker, I only ever got about 30% of what he said. I thought it's my Japanese skills. He used complicated sentences and words all over the place. But when I asked other Japanese coworkers, they told me they could not understand him either.
I work with mostly Polish engineers and I am struck by how clear and concise their English verbal comms are. I admire it actually.
I'm a native UK English speaker and I wish I had the simple directness that the Poles, Dutch etc have.
For example “bend over backwards”. I get the meaning, but my brain would never produce that phrase. I would say something like “adapts”, “compromises”, etc.
If you said this in Japanese, I'd say something like "Hmm, that seems a bit...". And you'd be expected to figure out what the rest of the sentence was.
To be more clear, I don't think the generalization you're making is valid. My experience of non-"Western" cultural communication styles has not at all been uniformly more direct and clear. I think some subcultures in the US have an annoying habit of doing what you describe (e.g. "if you can't follow this you must be dumb" kind of mentality) but many others do not.