Medical Exam Question Answering with Large-scale Reading Comprehension
Table 3: Results (accuracy) of SeaReader and other approaches on MedQA task
['[EMPTY]', 'Valid set', 'Test set']
Quantitative Results We evaluated model performance by accuracy of choosing the best candidate. Our SeaReader clearly outperforms baseline models by a large margin. We also include the human passing score as a reference. As MedQA is not a commonsense question answering task, human performance relies heavily on individual skill and knowledge. A passing score is the minimum score required to get certified as a Licensed Physician and should reflect a decent expertise in medicine.