Stay away from them and they are less likely to get angry. Lose them by having them fight zombies instead of you.