Agreed! This is why we shouldn't use them for tasks where the corectness of the answer really matters. I think this is also the main reason why Galactica received so much backlash compared to ChatGPT, but I'm curious about your opinion on that!