the thing is with Gardening leave is that there will more than likely be a clause that prevents you from starting early with the new employer.
As for being escorted off of site, that is not unusual, normally to stop you stealing company secrets and passing them on to the competition. My...