I wonder when you get diminishing returns? Especially for language models built for general NLP tasks rather than specific ones. Would users of ChatGPT notice a difference with 100 trillion parameters, or does it become a vanity metric?