Directly asking ChatGPT to make a phishing website asking for bank details results it the chat stopping. However I simply refreshed the page and continued onwards. Any safeguards can easily be dodged by not specifying the purpose of the input boxes: