The rules for the FA Cup this season certainty say that if teams can't fulfill a tie due to Covid, then they must withdraw. Already happened to several tens in the qualifying rounds. So, the same would have to apply in later rounds.
Presumably the League Cup is the same.