If you can trace the original owners who sold the land to the builders in the first place, they do have some rights, including, I understand, the right to re-possess in some cases - trouble is, the estate/farm/market garden or whatever that originally owned the land probably doesn't exist any more.