I usually start on the hardest available difficulty short of insane or whatever "harder-than-hard" setting.
Finishing the game feels like more of an accomplishment, and it makes the other settings seem a lot easier.
(when going back for achievements)
Also, in CoD4, I started on veteran to...