chatGPT provides excellent surface form coherency (well formed sentences) but their meaning need not be correct. It often ends up correct because of statistical correlations in the training data and because of RLHF tra