Physics professor tries out ChatGPT on exam questions and finds that: - it can't accept any diagrams, only text - tldr: is very strong in programming skills (e.g. Python) but weaker on understanding the underlying physics concepts motivating the question.