I sometimes feel that human intelligence may also be prediction-based. Kids can bullshit a lot if they are not educated not to lie. ChatGPT has not been properly educated. I dont think the underlying mechanism is at fault here. Possibly some fine-tuning can fix hallucinations.