Yeah, could include them, either stood around as a reserve for the 1st team, or if they were off playing a half-serious reserve game. Not exactly an insult though was it?
I think the reference to "stiffs" has moved on a bit since my playing days then. The stiffs were the kids/guys outside of the team, watching on. Didn't so much take it as a knock or a slight on them, more just a reference to people standing and watching on the sidelines getting cold, and well...