2. Even on things that are very clearly very in-domain for ChatGPT, it's still sometimes finicky. So even granting the hypothesis that alignment could solve all the robustness problems with LLMs, which I'm not sure I do, InstructGPT isn't t