Do go north, those amazon ladies have got lotsa cool loot. If you're really afraid, you can always just.. eh.. exploit.. a bit. Imoen with Hide in Shadows can just sit on the border of their Line of Sight, fire an arrow at them and that will pull two, or if you're lucky, just one.
=P