That should give you a clue that there are chinks in your armor. After completing one major quest location (The Circle Tower, Dalish Camp, etc. You need to keep your group in the rough center of the little fort and attack the walking corpses as they come into the fight.