Sheffield FC and Hallam FC are the oldest clubs.
The rivalry still exists although Sheffield FC currently play their home games in Dronfield.
The Hallam ground is still on the same site though, where the first match was played. Oldest ground in world football and an even older cricket ground...