Interesting talk w/ slides: language models like ChatGPT have emergent properties as the model gets bigger. Statisticians always tell us to use smaller models. But is the extra performance not linearly explained by size? Maybe the task is just too complex for small models?