The official website for The Settlers of Catan

Question about The Cards Fraternal Feuds - When may I draw cards to replace the cards I lost from my hand due to Fraternal Feuds?

Answer

If you lose two cards from your hand due to Fraternal Feuds, you may not replace them until the end of your own turn - unless you have a Pilgrimage Site. When you are the active player, however, you can take advantage of all opportunities that would provide your hand with more cards during your turn.

Note: The Pilgrimage Site belongs to the Age of Darkness expansion.