This problem is sometimes called *scalable oversight*. There are several ideas how to do this, and how to measure that we're making progress. The path I'm very excited for is using models like ChatGPT to assist humans at evaluating other AI systems.