Model-based annotation of coreference
Table 1: Inter-annotator agreement scores
['[EMPTY]', 'Exact Match', 'F1 Score']
The numbers clearly indicate that the grounded tasks introduce less uncertainty about the antecedents and hence result in more agreements between the annotators. Ideally the exact match and F1 scores for grounded tasks should be identical. However, the slight difference observed is because of mentions being linked to different similar looking entities. For example, in the sentence “Harry Potter is a global phenomenon. It has captured the imagination of …”, the mention It can be linked either to Harry Potter – the movies or Harry Potter – the books.