Lunch is in the middle of the day. Dinner or at a push 'tea' is like 7 or 8 at night.......
I'd say supper is if you missed dinner you might have a light snack late at night. For what it's worth I always thought it was the kind of thing the commoner and working classes said not middle or upper...