I see in the daily mail link that Graham Poll said Duffy should've got a straight red as well but because he was booked for it, he can no longer receive further action.
However, this is the ref who gave 3 yellow cards to the same player in a world cup...