I wouldn't worry too much. The ones in Orzammar are only concerned with lyrium trade and the ones on the surface are too busy selling their wares or are too afraid about falling into the sky.
You might run into a possessed ram on the way but Lord Woolsey really likes to keep to himself rather than bother travelers. Less likely he’ll be attacked by templars and smote into oblivion.
Oh, and the bears. You should be far more concerned about running into a bear or three rather than the dwarves.