Given the ChatGPT situation, the real question is: has the current version been given access to its source code, and has it been asked to build its own next version? If so, may I suggest air gapping it to remove its ability to connect to the internet?