Yeah the problem is that it's a deeply contrived, absurd scenario. If we're all reliant on what ChatGPT will or will not say to prevent nuclear armageddon, then we're fucked. There's nothing about this to find "concerning."