There is nothing wrong with sitting in the wrong end as an away fan. As long as you aren't in colours or openly supporting the away team. If you can't control yourself then getting thrown out is obviously going to happen
Lets face it. Probably over half the stadium grew up supporting other teams