People are noticing that ChatGPT can pass various kinds of tests like the Bar exam (lawyer) or tech interviews. Perhaps a signal that we are testing for the wrong thing. Test for problem solving, creativity, and learning. Memorization can be augmented.