Definitely get legal advice from a solicitor specialising in this. Ignorance or mistake sounds a defence but onus on you to notify changes and the DWP do and will prosecute especially against people who work. Think lot of people wrongly think just pay it back and all be fine-that's not how DWP...