gpt3 is misaligned it's trained for one task (next word prediction), and you have to do a bunch of prompt engineering and RLHF to align it to the downstream task you want (e.g. chatgpt is trained to be helpful, honest, and no