I used to wear them often. Now? not much. Back then I was very protective of my hats though.
One time a bully of mine had taken my hat(one of those original red and white pokemon hats) and played a little keep away with it before putting it on his head and walking away, laughing. My response? Fuck no I wouldn't let that fat bastard get away with it, so I flung my lunchbox strap around his neck and used it to climb on his back to retrieve my hat. It was hilarious, kinda like riding a horse, except instead of a horse it was an overweight preteen choking on a lunchbox strap. Let's put it this way: I had a "progressive" method in dealing with my bullies, and as a result, they deemed me way to dangerous to pick on. Never lost another hat to a bully after that.
Anyway, I mostly use hair ties, but other than that I don't really wear much in terms of hats these days. Considering getting an N7 Baseball cap to go with my hoody though.