It is learning from human after all. The model can hallucinate, like other models presented so far, when ChatGPT does not know the answer it still tries to answer (e.g. by providing wrong or nonsensical information).