Pair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All
TABLE X: Micro-averaged F1 performance of Pair-Linking (with NJS&EES as coherence measure) with four different percentage of NIL-mention settings. The F1 score is calculated on the linkable mentions.
['[BOLD] Dataset', '[BOLD] 0%', '[BOLD] 20%', '[BOLD] 40%', '[BOLD] 60%']
Specifically, for each document, we randomly sample few mentions and remove the ground-truth entities from their candidate sets. We report the disambiguation performance of Pair-Linking with the new setting. Note that in this experiment, we only consider medium-to-long text document which contains sufficient number of mentions and the performance is measured only on the linkable mentions. Since the local confidence of a NIL-mention and its candidate is usually low, any pair of linking assignment involving the NIL-mention will have low confidence score. Therefore, the assignment of the NIL-mention is not likely to affect the assignments of other mentions.