The agency introdced the candidate to you after you engaged their services?
If the candidate had initally accepted your offer, you would have been happy to pay the fee?
He has now accepted your offer and the fee is a lot less than it was?
Isn't this a win win here?