We evaluated the performance of ChatGPT on the United States Medical Licensing Exam (USMLE), These results suggest that these models may have the potential to assist with medical education, and potentially, clinical decision-making.