You'll be fine, a few years back I walked from Birling Gap to Cuckmere Haven under the Seven Sisters, the four hour window is ample amount of time. Wear good walking shoes as much of the ground will be chalk wave cut platforms covered with seaweed which is very difficult and slippery to walk...