The newest version of chatgpt uses data from the internet (more or less), but has thousands of employees rating the outputs (based on what would be most acceptable human dialogue) storing that info. Lex Fridman talks about