Usually people make this sort of argument when the the team has made three or four passes and dribbles, and lost what was a genuine advantage. I tend to not blame referees for not pulling it back (it's unfair on the fouling team to give you several chances when it's your fault you lost...