Perfectly acceptable, only need to inform the ref of the change to ensure no handball decisions going against the new keeper.
It has been fairly common in certain friendly games where the rules for the friendly allow x subs + 1 goalkeeper change, you then get the situation if all outfield subs...