Yep, I tried a bit, but I feel my initial suspicion of Chat GPT was correct. It has great pattern recognition and text generation abilities but doesn't seem to have a good ability to understand the context and do actual reasoning.