Good way to put it! A relevant post I just came across suggests "anon-myopic language model [i.e. ChatGPT] can 'compromise' on the loss of the immediate next token so that the overall loss over mutiple tokens is lower." Might be it. https