The official website for The Settlers of Catan

Question about General Questions Placed Cards - At what moment does removing certain Building s affect the number of resources and victory points received?

Answer

In most cases, immediately. Exceptions are expressly stated on the cards or in the game instructions.