Boosting Factual Correctness of Abstractive Summarization with Knowledge Graph
Table 6: Average relation matching rate (RMR) between the summary and the article in CNN/DailyMail test set. The definition of this metric is in Equation 7.
['Model', 'RMR1', 'RMR2']
As shown, FASum achieves the highest precision of correct hits under both measures. And there is a considerable boost from the knowledge graph component (FASum vs Seq2Seq): 13.6% in RMR1 and 17.3% in RMR2.