Actually our record then wasn't too bad at all. I think your recollection will be enhanced by the fact that between Christmas 1980 and Feb 1984 we played them seven times, and lost only once. Three wins (league once, cup twice) and three draws (league).
However, we lost out first three...