I try to at least look at the person, though I'm never sure how much eye contact is too much or too little. I remember hearing or reading somewhere that about 4 seconds at a time is "good", so if I find myself staring into someone eyes for too long I start limiting myself, glancing around or shifting my eyes away for a moment every 4 seconds.