Fine-Grained Entity Typing for Domain Independent Entity Linking
Table 6: Macro-averaged P/R/F1. Entity typing performance on the categories grouped by frequency. (1-100) is the most frequent group, and (10001+) is the least frequent group.
['Model', 'Total P', 'Total R', 'Total F1', '1-100 P', '1-100 R', '1-100 F1', '101-500 P', '101-500 R', '101-500 F1', '501-10000 P', '501-10000 R', '501-10000 F1', '10001+ P', '10001+ R', '10001+ F1']
The first group (1-100) consists of the 100 most frequent categories. The fourth group (10001+) is formed with the least frequent categories. Precision is relatively high for all groups. The first group (1-100) achieves the highest precision, recall, and F1, possibly leveraging the rich training examples. Recall drastically decreases between the first group and the subsequent groups, which suggests the model has difficulty accounting for the imbalanced nature of the classification of rare tags.