I know loads, simply because of work. I remember most of my colleagues internal extn numbers, and those 4 digits form the last 4 digits of the full external number, so I know those as well.
Other than work however, only really Mrs P's mobile and our home landline. Don't know my own mobile...