I'd just take it easy and ask casually first. Start by talking about what you remember, good times, funny stories about your Dad and his Mum and judge the reaction when you ask about your Grandad. Any hint of reluctance don't press or push it.
As they call in quite regularly I'm sure...