I actually think ChatGPT hallucinating facts is more of a capabilities issue than an alignment issue. how is it supposed to know what facts it knows? it would be hard even for a human to predict a priori which questions an unfiltered ChatGPT would be able to answer reliably.