A huge problem with models like ChatGPT is that there are always going to be human thumbs on the scale. A friend of mine did a series in where ChatGPT tells straight-up lies and then "apologizes"when called out on them.