Structure size and server lag

At what point does a server start becoming at the risk of lag due to player built structures and their sizes?