Except that ChatGPT and similar tools don't actually know anything about physics (or whatever). They merely reproduce the data they've been trained on, with all its flaws. See GitHub's CoPilot for the dangers even in AI tools designed for