I understand that InstructGPT - ChatGPT's elder sibling was quite ... "naughty" and ChatGPT was toned down. Microsoft's chat bot Tay became racist within a few interactions ... seems negativity is the default.