A Hierarchical Decoder with Three-level Hierarchical Attention to Generate Abstractive Summaries of Interleaved Texts
Table 5: Rouge Recall-Scores of ablated models (encoder-decoder) on the Pubmed Hard Corpus.
['Model', '[BOLD] Pubmed Hard Corpus Rouge-1', '[BOLD] Pubmed Hard Corpus Rouge-2', '[BOLD] Pubmed Hard Corpus Rouge-L']
Clearly, adding hierarchical decoding already provides a boost in the performance. Hierarchical encoding also adds some improvements to the performance; however, the enhancement attained in training and inference speed by the hierarchical encoding is much more valuable (see Figure 1 in Appendix C) Thus, hier2hier model not only achieves greater accuracy but also reduces training and inference time.