Of course there's the psychological impact - near misses have an impact as well, providing the driver isn't a sociopath! But it's the cyclist getting physically hurt, was my point. A driver's confidence can be rebuilt far quicker than broken bones would take to heal, etc. You're right though...
I really should get a dashcam for my bike. I cycle 8 miles to and from work all week and, without fail, someone tries to kill me once a day, minimum. Be it not stopping at a stop line, turning directly into my path or from time to time, pulling out directly in front when I'm heading down a hill...