HighRES: Highlight-based Reference-less Evaluation of Summarization
Table 6: TConvS2S and PtGen showing a disagreement between fluency and clarity scores. We italicized words that are not clear in the summaries.
['[BOLD] Model', '[BOLD] Summary Text', '[BOLD] Fluency', '[BOLD] Clarity']
From the example, we can see that the TConvS2S summary is fluent but is not easily understood in the context of ‘the duration of resignation’, while the PtGen summary has word duplication which lower the fluency and also lacking clarity due to several unclear words.