Data bottlenecks - pre-GPT: task-specific (private) - post-GPT: internet (public) - post-GPT3.5/ChatGPT: human in the loop data (private) After internet data is exhausted, most new data would be some form of (R)LHF, from users interacting / decision making with the models