People who say LLMs are pure BS generators haven't been paying attention. I have experimented with ChatGPT/Co-Pilot extensively. These models have learned things like geometry, symbolic reasoning, induction, skills we thought impossible to learn by just modeling the language.