BillSum: A Corpus for Automatic Summarization of US Legislation
(a) Precision Scores
['[EMPTY]', 'Rouge-1', 'Rouge-2', 'Rouge-L']
As discussed in the Results section, F-Scores encourage a balance between comprehensiveness and conciseness. All tested methods favor recall, since they consistently generate a 2000 character summary, instead of stopping early when a concise summary may be sufficient. For both datasets, the difference in Recall between the Oracle and DOC+SUM summarizer is a lot smaller than for Recall; which suggests that a lot of useful summary content can be found with an extractive method. In future work, we will focus on extracting more granular snippets to improve precision.