The main thing we're training stuff like ChatGPT to do is to produce stuff you'd think a human wrote. We pretend that this is the same as training to be factual or accurate, but it is not really the case. We actually train it to be a better bull