One way that I could see it coming sooner, is if we can decrease the amount of data necessary for the second part of the chatGPT training pipeline. Instead of optimizing for most probable text, they optimize for most "good" text, by using human