Learning to Summarize Passages: Mining Passage-Summary Pairs from Wikipedia Revision Histories
Table 3: Quality vs corpus size trade-off when setting the minimum overlap threshold value λ. The Good and Unsupported numbers are counted in a 50 random sampled subset.
['[ITALIC] Thresh. λ', 'Good (%)', 'Unsup.', 'Size']
For the 50 random examples, increase the threshold λ from 0.5 to 0.6 leads to a 12% absolute Good rate improvement with only 6,808 examples filtered. When increasing the threshold λ from 0.6 to 0.7, we only observe 2% Good rate improvement but the corpus size drastically shrinks to 68,070. Compared to the 56% good rate of the successful English Gigawords dataset, we choose the threshold value λ=0.6. Abstractive sentence summarization has attracted research focus in recent years Rush et al. Rush et al. They use the Annotated English Gigawords Napoles et al. Considering the Good rate of Psg2Sum is about 10% higher than the English Gigawords dataset, it is promising that Psg2Sum can achieve the same goal.