The official website for The Settlers of Catan

Question about Special Cards Axel the Innovator - May I remove an Abbey and replace it with a University?

Answer

No, even after removing the building the requirement for building it must still be met.