OpenAI is aware and up-front about its limitations! ChatGPT was tuned by RLHF, which asymptotically approaches helpful/honest/harmless, but it'll never get to 100% this way. I guess it's like self-driving cars - people tend to assume it's tru