Sort of like how some folks say 'everyone should meditate.' Maybe that worked for them and the issues they had, and that is brilliant, but lots of people don't have that problem or that response doesn't fit them.
I live in a rural area and don't get much noise at all other than wind and animal noises when I'm home alone. It is comfortable precisely because it isn't artificial. Going to a silent retreat means being around people who are intentionally suppressing their desire to speak and being expected to fit in. It is an intentional change in behavior, which starts out uncomfortable.