Ivy-Leaved Toadflax.
All about it here.
http://www.visitcobh.com/index.php/biodiversity-old-church-cemetery/ivy-leafed-toadflax/
Chemical control is the way to go, especially if it's growing out of walls. Even if you've got loads of it, it might be worth investing in a small hand-held sprayer...