LLMs like ChatGPT and language-vision models like DALL-E 2 are incredible, but the vast majority of outputs we see are cherry-picked. For these models to break through (i.e. be super useful to a wide audience) they will need better alignment with our intentions.