Found millwall fans to be fairly funny on the train after the game last season. More than likely will be fine as they are not the hooligans they used to be.
Swearing happens at football. Only way to avoid away fans is turn up very early, leave very late.