Facebook is horribly bad to execute on their good research so I don't want to defend FAIR. But this quote is out of context and not about the product, but the underlying technique. The major revolution behind ChatGPT remains the transformer