Optimizing the Factual Correctness of a Summary:A Study of Summarizing Radiology Reports
Table 3: Test set factual F1 scores for each variable on the Stanford dataset. ∗ marks statistically significant improvements with p
['Variable', 'PG Baseline', 'RLR+C', 'Δ']
We find that on both datasets, improvements in RLR+C can be observed on all variables tested. We further find that, as we change the initialization across different training runs, while the overall improvement on factual F1 stays approximately unchanged, the distribution of the improvement on different variables can vary substantially. Developing a training strategy for fine-grained control over different variables is an interesting direction for future work.