In Oblivion I always switch my Dark Brotherhood gear to civilian clothes in towns, despite the fact nobody notes or cares what I wear. I used to have a seperate armor even for just hunting deer in the wilderness because I imagined my superiors would not be happy with me using the sacred tools of the Night Mother for something so trivial.