Managed to convince ChatGPT to believe a false fact by providing it ChatGPT generated fictional information. Maybe not a good idea to use unfiltered user interaction data to train future instances. ChatGPT, however, did a good job resisting by demanding evidence.