However, there's a catch! LLMs can sometimes make stuff up due to the reward model prioritising human preference over factual information! That's why I'm sure you've seen the hilarious made up responses by ChatGPT, and the stupid response by Bard in Google's announcement...