Just do what we do in Hockey, rolling subs.
Or, continue with current system but do NOT stop time for subs. Game carries on while subs happen, you'll soon see players running to get off rather than dawdling across, shaking hands with the ref etc.
Also, only time time is stopped is if there's a...