Abstractive and Extractive Text Summarization
Table 11. Result of summarization for Semi-supervised Extractive Supervised Model. Training - 100K algorithmically labeled data, Evaluation-5K human judged. Extractive Context RNN (EC-RNN) shows best performance. Abstractive Contextual RNNs show significant improvements with large training data.
['Model', 'Token', '[ITALIC] Rouge1', '[ITALIC] Rouge2', 'Rouge', 'BLEU', 'Topic']
Training on 100 K approximate summaries does not lead to drop in metric. For example Rouge-1 drops from 0.39 (EC-RNN supervised) to 0.38 (EC-RNN semi-supervised). BLEU also remains comparable with 0.26 for 100K-dataset and 0.25 for 15-K dataset.