This is the key for me. The ability to go from a moment like that in the lift to Grandad using coffee as gravy within a matter of lines is something I don't think many, if any, sitcom writers have ever managed to accomplish so skilfully.
Nearly 25 million people tuned in to that episode, IIRC.