Pattaya is also a dump, remember this is from my own personal experiences, everyone goes to Thailand for different reasons. I'm sure many will find something in or around Phuket that they like, just not for me or anyone that I've travelled with (18-30 year old backpackers).
I'd say 3 days in...
Depends which part you went to I guess? Just like pretty much everywhere in Thailand, there are good areas and crap areas. I stayed at White Sands and really liked it.
Koh Samet is good for 3 days max imo.
This is my old post from the other Thailand thread linked, detailing places to possibly avoid and then places to definitely think about.
Will be very hot in Thailand now mate!
I used to live and work in Thailand as a tour op bouncing around between Bangkok and Krabi and everywhere in-between...