The most impressive thing about ChatGPT isnt actually how well it performs. The most impressive thing about it is how well it performs given how simple transormfer models are. Its the *unexpected* performance that is impressive