When you say "will it harm them?", are you suggesting you don't want to hurt the little buggers?
Sod that, kill 'em.
I had some nesting under a tree last year that attacked when I was mowing near the tree. Wait till it gets dark (so they'll all be back in the nest) and then unleash a whole...