Typically, if somebody trash talks me, I'll shrug it off, say "yeah, well (insert sarcastic comeback here)" or laugh (if it's actually funny). Now, if somebody offends my wife, then I get really angry. Normally, it's hard to offend her as well so I know that if something has offended her, it's worth me getting angry (like a guy a month or two ago who put something in his front pants pocket and told her to reach in and grab it. Did I mention that it was the same guy who has made other comments that are...well, lame and/or offensive ways of "flirting").
Short version: Most of the time, no. The quickest way to anger me is to offend my wife.