Another vote for the Imperial War Museum in Southwark - plus it's handy for the aforementioned Borough Market etc.
Plus I recommend the Imperial War Museum at Duxford (just off the M11) as well worth a trip if you are into planes and military vehicles/equipment. There is a heck of a lot to see...