Because it leads to over-dependence by officials. They'll check decisions "just to be safe", meaning the celebration of taking a wicket is often on hold while the decision is referred.
I've seen umpires referring to a replay for run-out decisions where the batsman is a MILE out of the crease. A...