I think they're hoping that since an entire chatGPT convo with a human in which it "fell" for those tricks is unlikely text (since a human wouldn't fall for them), eventually with enough data and a big enough model it will get better loss sco