I noticed this pretty quickly when playing around with ChatGPT. One problem of relying on these language models is that there is an assumption of credibility in the underlying data. This cannot be assumed, and filters will not eliminate data bias, just bad words.