As Sue1983 has demonstrated it is possible to go in among the home supporters and get away with it if you behave correctly ie keep your gob shut.
Somebody in the OP's group must have said or done something to alert the home fans that they were Newcastle supporters in a designated home area...