I remember reading something similar in Steven Redgrave's autobiography.
Where when he had retired, he was worrying about his fitness levels, where his muscular heart would turn to flab resulting in future issues.
He had to de-train, so as his heart could reduce down to a normal size.