Chat GPT is good at finding plausible reasons why code might have a vulnerability. Most of the time it is wrong. But the next leap is automatically write AND TEST exploit code on the vulnerability. Of course bad guys will hook this up to mainnet