Law 5 and the advantage the Referee is allowed to play is one of those huge grey areas as there is no stipulation of how long can elapse before that advantage is deemed over, or any other contributing factors to the referee deciding to bring it back.
I don't see how the answer that ref gave...