I live in the town centre and like others have said some is good some is bad. I am just down from the pier and it is not to bad, though can get a little noisy at weekends.
Meads / Old Town are the best places to live, but this is reflected in the prices. Also nice is Upperton and West Hampden Park.