Is it "Mad Sunday" when they close the roads and let any old amateur biker hurtle round the course. At a guess, I'd say that is when most of the fatalities occur, rather than on the actual TT races with the professional riders.
At the end of the day, it a "consenting adults" thing for me...