Massive Multi-Document Summarization of Product Reviews with Weak Supervision
Table 6: Manual linguistic quality scores of our system (level1-F1 variant) and the Medoid- F1 and Multi-Lead-1 baselines on the Electronics category.
['[BOLD] Criterion', '[BOLD] Ours', '[BOLD] Medoid- [ITALIC] F1', '[BOLD] Multi-Lead-1']
It is noticeable that the Multi-Lead-1 baseline is weakest, which is expected as the sentences are concatenated with complete disregard to each other. This behavior is expected to increase redundancy and weaken the flow of the narrative. The Medoid-F1 baseline “summaries” are actual human-written reviews, hence their scores are expected to be high. Our system’s results are close, and even surpass them in the focus and structure & coherence criteria. The main takeout is that our summaries are quite readable, which is inherently on account of the underlying FAS system by Chen and Bansal