LLMs have always been like that. ChatGPT is better than other models about admitting when it doesn't know the answer (because of RLHF fine tuning) but it still makes up completely false stuff all the time.