ChatGPT works the way I predicted in these 2021 tweets. I knew people who were working on this kind of editing, the answer was to use RL for this to tweak the LLM. "Language is the house of being" -- this fight is for all the marbles. Get in it.