I can tell you that - it's because the Marquess of Abergavenny is also the Earl of Lewes. The family name is Nevill (hence Nevill Estate in Lewes). Even more confusingly, the family seat is in Eridge, Kent.
You could also ask why Arundel is the family seat of the Duke and Duchess of Norfolk or...