It's worth pointing out at least that there is a qualitative difference between silence in isolation, and being around people who are intentionally being silent.

I live in a rural area and don't get much noise at all other than wind and animal noises when I'm home alone. It is comfortable precisely because it isn't artificial. Going to a silent retreat means being around people who are intentionally suppressing their desire to speak and being expected to fit in. It is an intentional change in behavior, which starts out uncomfortable.