This is my experience as well, with R programming. It *can* come up with great solutions, but it's really up to you to know when they are correct. But if ChatGPT could run its own code, presumably it could actually learn...