If you're experimenting with or discussing ChatGPT, hold onto this nugget: ChatGPT uses a reward system that can be over-optimized and eventually hinder performance due to a principle called Goodhart's Law (once a performance metric is deemed status quo, it tends to collapse).