ChatGPT marks a significant improvement in NLP models on the tasks of medical QA (example below). By performing at a greater than 60% threshold on the NBME-Free-Step-1 , we show that the model achieves the equivalent of a passing score for a third-year medical student. 1/6