"As AI systems become more capable, we would like to enlist their help to supervise other AIs." We've all seen many instances of ChatGPT gone awry. Toxic or harmful outputs are one of the biggest hurdles to mass deployment of LLMs today. 2/