Yes, AI is currently great at generating correct-sounding bad information. I asked ChatGPT what the correct amount of fertiliser for custard apples is. While this looks correct to anyone who is not an expert, the fertiliser ratios are made up, and this advice is bad.