Muhammed Ali was well beaten in several of his later fights, as well as losing the heavyweight title twice. Lance Armstrong was massively improved by performance-enhancing drugs, so I wouldn't put either of them in the mix.
Tom Brady and Don Bradman would be in the conversation. Maybe Jahangir...