Animals spawn inside my house and break it.

So, I have a rather large house I built recently, it is was expensive to make and took alot of time, it keeps getting destroyed by NPC's who decide to venture right next to my house and cut down a tree that falls on my home, also animals spawn inside it every time I return from a different realm and they seem to bug inside the walls and roof and destroy them occasionally.