The official website for The Settlers of Catan

Question about “Traders & Barbarians” Expansion The Fishermen of Catan - When exchanging fish tokens, may I take a fish token of my choice from the discard pile?

Answer

No, you must draw from the face-down fish token supply.