Distant Supervision for Relation Extraction beyond the Sentence Boundary
Table 6: Sample precision and error percentage: comparison between the single sentence and cross-sentence extraction models at various thresholds. Single sentence extraction is slightly better at all thresholds, at the expense of substantially lower recall: a reduction of 40% or more in terms of unique interactions.
['[EMPTY]', '[BOLD] Prec.', '[BOLD] Entity Err.', '[BOLD] Relation Err.']
With either classification threshold, cross-sentence extraction clearly outperformed the random baseline by a wide margin. Not surprisingly, the higher threshold of 0.9 led to higher precision. Improved entity linking, either alone or joint with relation extraction, is an important future direction.