It occurs to me that ChatGPT represents a perfect testbed for theories of AI alignment: its creators actually want to constrain its behaviour in certain ways but they're totally unable to do so. Something that was hypothetical is now a problem faced by engineers