ChatGPT and any LLMs trained on research literature dont have a good grounding in scientific truth. The same thing happened with Galactica. LLMs (so far) can do a decent job on problems theyve seen before, but make shit up for anything new.