Yeah, I was going to post something similar. ChatGPT is not really 'artificial intelligence'. At the moment at the very best it's a kind of idiot savant: brilliant at processing existing data but not really capable of original thought, merely giving a pretence of it.
Of course we don't know...