A lot of the data used to train these LMMs like ChatGPT are just scraped from the internet and have minimal preprocessing before being used to train. Very little actual curation happens because the amoun