LLMs don't need much or any annotated data but to be truly useful, they do need access to non-web data. LLM products are supercharged when they know your personal context. chatGPT that's read your emails, calendar and docs. Doing this whilst preserving privacy is critical.