ChatGPT, GPT-3, GPT-Neox and other models are not producing factual information, even though it appears accurate. However, I won't be surprised if the upcoming versions of ChatGPT will generate "factual" information. I think GPT-4 will do the same.