Ultimately, ChatGPT even exceeded the performance of PubMedGPT, a counterpart model trained exclusively on biomedical domain literature, which scored only 50.8 percent on an older dataset of USMLE-style questions.