Don't think you can see it from the racecourse. I'm guessing he is looking at the back of Bevendean ?
Probably this https://www.google.co.uk/maps/place/Bevendean,+Brighton/@50.8461907,-0.1025137,150m/data=!3m1!1e3!4m5!3m4!1s0x487585f71257cd3d:0xf6f9778e48e5dc42!8m2!3d50.839466!4d-0.097099...