At least for me, the signal I'm sending is "I care more about how comfortable I am in my clothes than I do about what other people are inferring about them". The point isn't that people aren't receiving some sort of signal about me based on that, it's that the signal that they might receive is entirely irrelevant to my motivations. That itself might be a signal, but it's incidental to the actual choice I'm making, which is entirely personal.