I dont think the recent jail breaking of chatgpt actually illustrates these points because firstly OpenAI was releasing this as a beta and warned users that it may return unsafe text, and secondly, i think OpenAI mostly only used enough safety constraints to avoid PR disasters