Revisiting Challenges in Data-to-Text Generation with Fact Grounding
Table 9: Error types of manual evaluation. Total: number of sentences; RP: Repetition; WC: Wrong Claim; UG: Ungrounded sentence; IC: Incoherent sentence
['Model', 'Total(#)', 'RP(%)', 'WC(%)', 'UG(%)', 'IC(%)']
To gain more insights into how exactly NCP+TR improves from NCP in terms of factual accuracy, we manually examined the outputs on the 30 samples. We compare the two systems after categorizing the errors into 4 types. The NCP+TR generally produces more concise outputs with a reduction in repetitions, consistent with the objective for table reconstruction.