It occurred to me that if LLMs (ChatGPT and such) are limited in their training by paywalls erected by corporate copyright holders (Elsevier etc) then there will eventually be pirated models that dont, and they would potentially be far far better?