I certainly used to when I was younger (late 60s early 70s), although I was more of a Chelsea fan than anything. There was no conflict as the two clubs weren't rivals, plus Brighton were third division and Palace where 1st/2nd. In fact I only went to the Goldstone when I couldn't watch decent...