Rotting walls?

My base is located in next valley and i have encountered many buildings that have very very good stuff in them but all the walls are gone do walls rot or are people blowing it up and not taking the loot? thanks guys.

thanks :smiley: