Model-based annotation of coreference
Table 2: The macro-averages of MUC, B3, and CEAFϕ4. (∗assumes gold brackets for mentions.)
['[BOLD] System', 'Wiki  [BOLD] P', 'Wiki  [BOLD] R', 'Wiki  [BOLD] F1', 'QuAC  [BOLD] P', 'QuAC  [BOLD] R', 'QuAC  [BOLD] F1']
\newciteelcoref-qa use a multi-task architecture for resolving coreference and ellipsis posed as reading comprehension, which is also trained on OntoNotes 5, but uses gold bracketing of the mentions and performs only entity linking. The results show that the dataset is hard even for the current state-of-the-art and thus a good resource to evaluate new research.