I broke ChatGPT by asking it A, then asking it B, then telling it to put A B together to reach a conclusion about C; then, after it succeeded (correctly), I pointed out that it recombined info on which it was trained, in a way going beyond that training by itself. It went .