The only thing that's ever bothered me is when there's a time limit for something difficult. It's gotta be something really annoying though, like playing Mile High Club on Veteran difficulty. That pissed me off.
Overall though, even that, which is at my angriest, I've never broken anything, or smashed anything. I don't get that angry, just frustrated. Then I stop playing.