I switched to a double edge safety razor a few months ago and it gives the best shave I've ever had with no razor burn. I sometimes us an old fashioned straight razor too.
For shaving soap I get arko from amazon or ebay for about £1.50 a stick, it's unperfumed, lasts for months & lathers up well...