In fact, I tried this in a recent essay. ChatGPT produced a coherent but utterly boring bit of text. I then went through and changed every example it cited, replaced 98% of all words, and had a much more interesting essay.