I don't wear gloves, but I have this weird condition with my hands that causes them to sweat near constantly unless cooled below temperatures of roughly 22^oC. Because I live in stinking hot North Queensland (Australia) that is almost 24/7... unless it's winter and I'm realllly lucky.
This causes massive problems for me when it comes to paper work, exposed electronics and anything water-sensitive. Paperwork has these ugly blotches of wet on them (try putting your hand under a tap, drying lightly and then trying to sign an important form, every time before you need to do something with paper) and I regularly find myself handling electronics for some reason which I am not aware of, which usually means they end up fried when we try to use them. By electronics, I mean computer hardware.
At one point in my life, I tried taking a small hand towel with me in my pocket, only to find it often didn't fit in there quite right, making my pocket bulge like something was growing on my leg, and leaving it hanging out was just too dangerous; not that people might steal it, but rather it might just catch on something and I would't realise it.
So, now that my rant is over (feels good to finally say something to what small portion of the world will actually read this), I will re-iterate by saying that while I don't wear gloves, I really should.