We went to the Museum of London before the Millwall game, and there's no end to see there, so that's a good call in my book. If you want a gallery that's not a big name, then the Whitechapel usually has some interesting stuff on, and has been (beautifully) refitted recently.