Referees are ambitious, and those in the Prem are scared to upset the managers for fear of being marked down.
This is also true in the feeder leagues, so refs turn a blind eye to abuse, and then the poor kid who is a bit shit at football but loves the game, so decides to have a go at...