Actually the "y" in "ye" was because printers would use "y" in place of the letter thorn þ because they often wouldn't have a block for thorn, since most sets just covered the Latin alphabet. So the used y as they considered it to be closest.
Thorn was eventually replaced in English with the...