Even more interestingly, when asked directly to check that its response meets a specific constraint, ChatGPT *does* detect the mistake. But then proactively offers a corrected version that is still wrong. Fascinating.