the current chatgpt implementation doesn't do this, but people using the gpt api can not only generate python but execute it, and simply not reveal this. it's easy to imagine another iteration of chatgpt that privately writes code, executes it