The official website for The Settlers of Catan

Question about The Cards Riots - What happens if only one player can lose a unit but not the other player?

Answer

Then only one player loses a unit and the other one doesn't.