"Its completely remarkable that a few-hundred-billion-parameter neural net that generates text a token at a time can do the kinds of things ChatGPT can. And given this dramaticand unexpectedsuccess, one might think that if one