The official website for The Settlers of Catan

Question about Wizards & Dragons Change Places! - Can I move a Building to an empty building site?

Answer

No.