A Cluster Ranking Model for Full Anaphora Resolution
Table 7: The average mention importance attention scores in the conll development set, grouped by mentions position and cluster size in the final clusters.
['Size', 'Positions 1', 'Positions 2', 'Positions 3', 'Positions 4', 'Positions 5-7']
Mention Importance We first assess our hypothesis that our attention scores can capture mention importance–i.e., the finding from the linguistic and psychological literature on anaphora that the initial mentions of an entity tend to include more information, whereas the following mentions are generally reduced. We computed the average attention scores for mentions in a cluster in order of mention. Clusters that have different size are analysed separately, as scores from different-sized clusters are not directly comparable. As we can see from the Table, after analysis the attention scores assigned to the mentions at different positions in the cluster, we find that the attention scores assigned to the first mention in a cluster are always higher than others, which is in line with linguistic findings that mentions introducing an entity are more informative. This suggests that our attention model does capture something like mention importance.