I guess you're judging the man purely on the lovable idiot role he plays on QI, and no other aspect of his life.
That'll be like entire judging John Terry as a solid, reliable, dependable bloke, based on his centre abilities.
Him directly.
AD read that on his podcast having written it after the Arsenal Chelsea match.
He did walk it back by saying afterwards, 'but we've just beaten Spurs so I feel better now'.