Since when do fans disappear from premiership matches?
When promoted you will get 10/15k extra fans appear and I agreed about if you get relegated as you'll lose a lot of the casual support.
Most championship clubs lose about 10k supporters when relegated