The irony being, if we must engage in social discrimination, that the surrounding areas do have large pockets of affluence. Crystal Palace itself, the spiritual epicentre of the club, is one of the most desirable areas to live in London (and is actually part of Bromley not Croydon).
Unfortunately, it's a nickname that those of us associated with Whitehawk have oft had to endure. 'That lot up the road' is the sanitised reference I use for them. I'm getting old.
I always found that 'Crystal Palace' works well for me. I've always known them as that. I don't normally have to explain myself to others with that one.