I do, quite often. Not excessively so, although sometimes, like recently, I fidget enough that the skin at the base of my thumb, between the thumb and index finger, gets all hard and starts to hurt a bit. That's about the extent of it, though I do twiddle with a pen and stuff as well in lectures or when I'm bored...