I am seeing this too. Even with code snippets, I reply to ChatGPT with the error message and it admits the inital code it provided was wrong and then corrects it. Ideally it wouldn't be providing code which doesn't run.