The official website for The Settlers of Catan

Question about The Cards Irmgard, Keeper of the Light - Do I receive a resource for Irmgard if a card of my opponent is removed from my principality?

Answer

No, Irmgard only has an effect if your own cards in your own principality are concerned.

Note: Cards that your opponent may build in your principality belong to the Age of Darkness and Age of Enlightenment expansions.