Does ChatGPT get this difficult case wrong too? Yes. If asked to be careful, or given hints, does ChatGPT give any indication that there's a problem? Usually not! However, careful prompting and follow-up discussion, or asking in Chinese can work: