I variously use nitrile, vinyl, and poly gloves when cooking messy things at home in bulk, like chicken, bacon, etc. I regularly pull them off to do something and then throw a new pair back on. They can be kinda sweaty and it's... fine. Zero problem whatsoever sliding on a new pair.

I'm not doubting your personal experience. I'm just saying it's in no way a universal rule. I'm sure experiences will be different depending on glove material, glove size, and just the different shapes of different people's hands.

But for me and for plenty of people I've worked with earlier in my life, swapping gloves was way faster and easier than washing hands again. Plus, washing your hands like 40 times in a shift is going to dry them out. It's not great.