I go to Fulham from time to time if they're at home and the Albion are away and I can't/can't be arsed to go, and the atmosphere has always been crap when I've been there.
I think it's not necessarily the stadiums themselves anyway, though it can help with different acoustics, and places like...
The problem with that is that we are struggling to get fans in as it is, also we have a limited time to build the stadium before we lose planning permission. More court battles and another 10 years at Withdean? I doubt there'd be a club left to need a stadium.