I usually abandon hat first village. It's just not worth it. Convert the nearby one, and protect you temple. Then, deactivate the fireballs, ect., and rebuild your first.
If you want to save that village, when the dvisors mention that the fireballs are getting awfully close to the village, make...