ChatGPT wasn't as successful explaining how RLHF works. Perhaps they will use this blog post to further fine tune it via RLHF, thus leading it to better explain itself from considering its own output, and I find that haunting.