You might be relaxed about it, and be able to ignore it, but the abuse all feeds into the belief held by many that refs are corrupt incompetents, and (for a few hotheads) fair game for abuse and physical assault.
How about a certain Brighton manager? Roberto didn’t have to say what he said about referees either. He’s a role model, and there are thousands of kids out there who will have heard that.