How ChatGPT Works Here we see how the model was created, and how the new method of "self attention" combats a few of the downsides of previous chat bots. Those are: Lack of helpfulness Contain hallucinations (untrue facts) Including toxic or biased content