I think more than anything he will be annoyed that he didn't cash in when his stock was high to get a decent top-of-the-Championship job with a big club. That may now never come along again.
It is a tough one for managers in that situation - loyalty, or making hay, they are conflicting forces...