You can do both if you wish. If you hire a bike on the seafront you can bike the bridge, have lunch in Sausalito then get the boat back. You don't need to be Bradley Wiggins for the bike ride as its mostly flat.
Alcatraz is good. The OP will enjoy that.
My favourite city San Francisco. Great...