I know ChatGPT's design aims to prevent it saying sluts to try to avoid Microsoft's Racist Bot mistake, but still... Another thing very relevant for defence is risk of safety measures getting overridden we see