ChatGPT in particular has a problem of being extremely confident even when it's incorrect. Once you start asking questions very specific to a field it will confidently regurgitate BS. That's why you really need a human in th