Something I wonder about is a degrading feedback signal kind of thing. Like if chat GPT is trained on a snapshot of 2021 web, what happens when the web gets filled with GPT content, and then the GPT is trained on that?