Edit. Probably not enough time then but don't forget you'll have free travel to Haywards heath with your match ticket so you only need a ticket from Victoria to HH
Is there a big gap between arriving and departing London? As you could probably get an earlier train from London Bridge? Don't think the specifictrain matters for the london to Sussex bit but someone else will confirm.