Great thread. Models like ChatGPT are probabilistic language generators. Not oracles. Not search engines. You are getting a stream of highly probable words given the context and training data. Answer "accuracy" is largely a matter of chance + prompting. Be very cautious.