fine line between "playful banter" and bullying, and often bosses will turn a blind eye to make their lives easier.
Construction is a very lad orientated environment and it is probably thought of as "character building", and they probably don't think they are bullying I would think as it likely...