It's fine with a bit of planning. If you have a match ticket it includes a travel voucher so you only need to buy a return to Haywards Heath (about 10-12 miles north of Brighton). The voucher does the rest.
The big delay is getting out of the ground after the game and back on a train. If you...