NegBio: a high-performance tool for negation and uncertainty detection in radiology reports
Table 3: Evaluation results on OpenI, ChestX-ray using (1) MetaMap, (2) MetaMap and NegEx, and (3) MetaMap and NegBio. Performance is measured by precision (P), recall (R), and F1-score (F) on positive findings.
['Method', 'OpenI P', 'OpenI R', 'OpenI F', 'ChestX-ray P', 'ChestX-ray R', 'ChestX-ray F']
The \nth1 and \nth2 rows demonstrate that negation/uncertainty detection dramatically improves the precision (from 13.8% to 77.2%), even with a baseline approach. As a result, the F1-score also increases significantly (from 23.8% to 80.7%). This observation proves the usefulness of negation detection in the task of information extraction. The 2nd and 3rd rows compare NegEx with our method NegBio. Overall, NegBio achieved a higher precision of 89.8%, recall of 85.0%, and F1-score of 87.3% on OpenI.