If your not unfit one option is to park in Withdean near the London road and walk direct to the stadium along Carden Avenue and across or round Wild Park.
3 miles is not much of a stretch and can be done in 50mins, far quicker than waiting for the buses.
I know I'm no longer a ST holder but...