It's not just long baggy shorts that are a no-no. I wore a pair of trunk-sized shorts (ie covered by groin area but not the legs) and was told that they were unacceptable. I have a pair of budgie smugglers that are solely for France now.
Some French pools insist you wear a cap too. It's hard...