Generating Wikipedia by Summarizing Long Sequences
Table 3: Comparison of extractive method and corpus with L=500, and the Transformer E-D model
['[BOLD] Extractor', '[BOLD] Corpus', '[BOLD] Test log-perplexity', '[BOLD] ROUGE-L']
Extractive method: There is a significant gap between doing nothing, identity, and extractive summarization, tf-idf. Further, there is a significant gap between tf-idf and the cheating extractor, suggesting future work in improving the extraction step could result in significant improvements. One possibility is to train a supervised model to predict relevance ( For subsequent experiments we fix the extractive method to tf-idf. In subsequent experiments, we report only the combined results.