I was into both (at the time I was more a fan of Madness) but the Specials always seemed far cooler and more authentic, so now I'd say the Specials.
If anyone gets chance though, have a look on YouTube at 'The Prince' video. What I'd have given to be one of them at that time...