So, everyone talking about chatgpt but take a look at this trivial math error it made. The first line is correct and then it just... does basic arithmetic wrong. This is a fundamental issue that goes far deeper than simply "it will learn how to be better."