It may be a good idea to have the proposed meeting and try and find some middle ground where you can discuss each others grievances.
Maybe start the meeting by apologising for telling him to p off, explaining that you were not feeling too good on that day. Small gesture but hopefully will break...