May not be funny to everyone. That's the nature of jokes. Fair enough.
I believe it most certainly isn't a racist joke though. The complete opposite in fact. That may also be up for debate, but that's where I stand on it.
I think you need to re read the joke to see who the subject of the joke is.
Thanks for the invite. Can I bring along my black African wife, and our four kids?
The OP's joke puts me in mind of this one....
A plane was losing height due to engine failure and in danger of crashing.
The pilot, a white racist, decides drastic action is required, so makes the following announcement to the passengers.
'I regret to have to inform you that due to engine...