What's most interesting about this is that almost all "failure" modes of ChatGPT are due to it being very context sensitive. All the previous models used to fail due to exactly the opposite reason. This is *the* hard problem to solve in language modelling, imo.