Harborne is walkable from Edgbaston and has loads of pubs. My favourite is The Plough on the High Street, especially if you are looking to eat.
For a drink in the city centre, with decent beers, there's the Welington, Post Office Vaults, Shakespeare, Old Joint Stock, Old Contemptibles, Cosy...