Everything depends on how quick your punch was and how fast the opponents reactions are.
That said, if you were properly trained/disciplined in disarming/disabling another person, you'd know that a punch to the face as an initial attack wouldn't at all be the most affective method.
You'd also...