That's only when the appeal is actually frivolous. If its an appeal in good faith, the ban isn't increased, and looking at how minor the collision was, I don't think it's frivolous to appeal.
Deliberate handling of the ball, denying goal scoring opportunity - 1 game ban
Foul and abusive language (including gestures) - 2 game ban
Serious foul play, violent conduct, spitting - 3 game ban