Since chatgpt uses the instructgpt model, you can find the human feedback dataset they use here: I couldn't find instances of Covid policy after performing a quick grep. Unless chatgpt is using a different fine-tu