And I think that's the answer; people who don't want to talk will simply tell you! And everyone carries on.
It's one thing to not want it and to be comfortable not wanting it, but viewing it as rude goes way beyond that and is not rational.
I am bothered by random people wanting to talk to me -> Randomly talking to other people would bother them -> Bothering people is rude -> Randomly talking to people is rude.
Hence why the platinum rule is better. Once you know that other people (apparently!) aren't bothered by randomly striking up a conversation, you can adjust your actions accordingly.