DynE: Dynamic Ensemble Decoding for Multi-Document Summarization
Table 3: Evaluation results on MultiNews test set.
['[BOLD] F-score Method', '[BOLD] F-score R1', '[BOLD] F-score R2', '[BOLD] F-score RL']
Using only one randomly selected document already outperforms the state-of-the-art on this dataset, but adding more inputs into the ensemble hurts performance slightly. This is an unexpected result which warrants further investigation; however, preliminary inspection reveals that some clusters in MultiNews contain a document which is very similar to the reference summary, thus in the case that this particular document is selected as input, the evaluation results are artificially high. We plan to investigate issues with the MultiNews dataset further when time allows.