Learning to Summarize Radiology Findings
Table 3: Cross-organization evaluation results on the Indiana University chest x-ray dataset. All the ROUGE scores have a 95% confidence interval of at most ±1.10 as calculated by the official ROUGE script.
['System', 'ROUGE-1', 'ROUGE-2', 'ROUGE-L']
We use the publicly available Indiana University Chest X-ray Dataset Demner-Fushman et al. We filtered the reports with the same set of rules and arrived at a collection of 2,691 unique reports. We used this dataset as the test set, and ran our best model trained on our own dataset directly on it. We find that our model again outperforms the baseline extractive model substantially in this transfer setting, and the generated summaries are both grammatical and clinically meaningful.