TBH I would suspect the fire first. I may be imagining things but the suggestion seems to be you use the fire, you start noticing damp? You cant see the vent... I suspect bad condensation.
Nowadays gas fires have their own steel vent that sits inside the chimney. Surprisingly easy to fit if...