I will rejoice on the day such tittle tattle means jack shit to the British electorate. It would be hugely depressing if Cameron was sunk because of this.
Seriously, the only time it should ever matter is if you're a party stupid enough to campaign as "the party of family values" or some such...