You're in for a treat.
Otago peninsula from Dunedin is great. In particular a trip to Sandfly bay where you can see sea lions basking on the beach. You can also spot penguins there too.
Another vote for Franz Joseph. We did the glacial walk which was a really great experience.
Abel Tasman...