Asking ChatGPT what the brightest star in Orion is switches the answer between Rigel, Betelgeuse, and it cant answer since its just a dumb language model. ChatGPT is amazing! But its model is clearly just optimizing for what sounds good, not what is accurate.