Closed-Book Training to Improve Summarization Encoder Memory
Table 1: ROUGE F1 and METEOR scores (non-coverage) on CNN/Daily Mail test set of previous works and our models. ‘pg’ is the pointer-generator baseline, and ‘pg + cbdec’ is our 2-decoder model with closed-book decoder(cbdec). The model marked with ⋆ is trained and evaluated on the anonymized version of the data.
['[EMPTY]', 'ROUGE 1', 'ROUGE 2', 'ROUGE L', 'MTR Full']
We first report our evaluation results on CNN/Daily Mail dataset. In the reinforced setting, our 2-decoder model still maintains significant (p<0.001) advantage in all metrics over the pointer-generator baseline. and have a 95% ROUGE-significance interval of at most ±0.25.